00000001:02000400:3.0F:1787790531.524475:0:3292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787790550.256949:0:3515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787790552.127299:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 569 MB/s 00000001:01000000:3.0:1787790552.377224:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 811 MB/s 00000001:01000000:2.0:1787790552.629570:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5567 MB/s 00000020:02000000:3.0:1787790553.324252:0:3607:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_50_g504224c 00000400:02000000:0.0:1787790554.521518:0:3622:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.122@tcp [8/256/0/180] 00008000:02000000:3.0:1787790558.324213:0:3772:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787790618.119642:0:5740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787790631.569503:0:6490:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790631.569509:0:6490:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787790631.569510:0:6490:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787790631.569631:0:6490:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000096a53c70 00000080:02000400:2.0:1787790631.569642:0:6490:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787790631.586324:0:6490:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787790631.586338:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787790631.586448:0:6490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a596f0ce) 00000020:00000080:2.0:1787790631.586470:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787790631.662980:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787790631.663077:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787790631.706274:0:6490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787790631.706512:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787790631.706520:0:6490:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790631.706533:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d4e7 00000020:01000004:2.0:1787790631.706541:0:6490:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787790631.706546:0:6490:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787790631.706551:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000096a53c70 from MGS 00000020:01000004:2.0:1787790631.706555:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787790631.706565:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005278b559) 00000020:00000080:2.0:1787790631.706574:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787790631.706634:0:6490:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000096a53c70 from MGS, refs=2 00080000:01000000:2.0:1787790631.706639:0:6490:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787790631.706644:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d4f5 00000100:00100000:2.0:1787790631.706796:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787790631.706925:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787790631.706931:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787790631.714749:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787790631.714766:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787790631.715848:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790631.717038:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787790631.717052:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787790631.718322:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787790631.718332:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0F:1787790631.720857:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787790631.720874:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787790631.736361:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790631.736367:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790631.736369:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790631.736749:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790631.736751:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790631.736753:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790631.737545:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787790631.746959:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787790631.987336:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1791 MB/s 00000001:01000000:3.0:1787790632.237008:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2859 MB/s 00000001:01000000:3.0:1787790632.489898:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 501 MB/s 00000001:01000000:0.0:1787790632.741240:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 679 MB/s 00080000:10000000:0.0:1787790632.758254:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1787790632.775249:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787790632.776259:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787790632.776313:0:6490:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787790632.776357:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787790632.776640:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787790632.776661:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787790632.779489:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790632.779682:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787790632.779688:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787790632.780573:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787790632.780582:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:2.0:1787790632.781046:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790632.782132:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787790632.782142:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787790632.785198:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787790632.785222:0:6490:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.122@tcp' 00000020:01000004:2.0:1787790632.785224:0:6490:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787790632.785268:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.122@tcp (typ=mgc) 00000020:00000080:2.0:1787790632.785281:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.122@tcp (000000008a8f2aa9) 00000020:00000080:2.0:1787790632.785297:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787790632.785376:0:6490:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007908fe33@MGC192.168.202.122@tcp: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787790632.785555:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.122@tcp-0 is initialized 00000040:01000000:2.0:1787790632.785563:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787790632.785847:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787790632.785874:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.122@tcp (uuid a75db525-924f-489b-b982-1d04f64567fb) 00000020:00000080:2.0:1787790632.785889:0:6490:0:(genops.c:1385:class_connect()) connect: client a75db525-924f-489b-b982-1d04f64567fb, cookie 0xcf9477fddcf1d503 00000100:00080000:2.0:1787790632.785901:0:6490:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787790632.785906:0:6490:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import 000000007908fe33 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790632.785948:0:6490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cfa46f2c x1874634267951232/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790632.785967:0:6490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a75db525-924f-489b-b982-1d04f64567fb->MGS 00000020:01000004:2.0:1787790632.785985:0:6490:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787790632.786009:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787790632.786018:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a54ef633) 00000020:00000080:2.0:1787790632.786026:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1787790632.788201:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1787790632.789044:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfa46f2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634267951232:0@lo:250: 00000100:00100000:0.0:1787790632.789137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790632.789217:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267951232 00000100:00100000:0.0:1787790632.789227:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267951232 00000100:00100000:0.0:1787790632.789277:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790632.789284:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007944b1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1874634267951232:12345-0@lo:250: 00010000:00080000:0.0:1787790632.789313:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a75db525-924f-489b-b982-1d04f64567fb@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1787790632.789338:0:6505:0:(genops.c:1385:class_connect()) connect: client a75db525-924f-489b-b982-1d04f64567fb, cookie 0xcf9477fddcf1d511 00000100:00080000:0.0:1787790632.789482:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000476aec3c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790632.789535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007944b1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+5:3637:x1874634267951232:12345-0@lo:250: Request processed in 251us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790632.789542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790632.789577:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787790632.789585:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1787790632.789592:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787790632.789596:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787790632.789600:0:3637:0:(import.c:65:import_set_state_nolock()) 000000007908fe33 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787790632.789602:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787790632.789605:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787790632.789608:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfa46f2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634267951232:0@lo:250: 00000100:00100000:2.0:1787790632.817284:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790632.817512:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787790632.817518:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787790632.826517:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787790632.826537:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787790632.827082:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787790632.827089:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787790632.827792:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790632.827986:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787790632.827991:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787790632.829856:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787790632.829871:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787790632.883187:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790632.883402:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787790632.883408:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787790632.893575:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787790632.893595:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787790632.894353:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790632.894542:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787790632.894547:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787790632.895270:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787790632.895277:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787790632.895975:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790632.896158:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787790632.896164:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787790632.898339:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787790632.898351:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787790632.899097:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790632.899252:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787790632.899258:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787790632.904969:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787790632.904989:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787790632.943249:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790632.943702:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787790632.943902:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787790632.948915:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787790632.948938:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787790632.956528:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787790632.959898:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787790632.963514:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787790632.963555:0:6490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787790632.963563:0:6490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787790632.963754:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787790632.963802:0:6490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787790632.963807:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787790632.963809:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790632.963810:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790632.963811:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790632.963813:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790632.963814:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790632.963815:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790632.963816:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790632.963818:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790632.963819:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790632.963820:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790632.963822:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787790632.963824:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787790632.963827:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790632.963828:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790632.963829:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790632.963830:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790632.963831:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790632.963832:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790632.963834:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790632.963835:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790632.963836:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790632.963837:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790632.963838:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790632.963839:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787790632.963867:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787790632.963884:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3b2cacc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951360:0@lo:253: 00000100:00100000:0.0:1787790632.963961:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790632.964017:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000001891311a going to sleep for 11 seconds 00000100:00100000:3.0:1787790632.964942:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267951360 00000100:00100000:3.0:1787790632.964952:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267951360 00000100:00100000:3.0:1787790632.965018:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790632.965027:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bf90c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+5:6490:x1874634267951360:12345-0@lo:253: 20000000:01000000:3.0:1787790632.965089:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787790632.965092:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787790632.972589:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787790632.972673:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787790632.973028:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790632.977553:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787790632.977998:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787790632.978004:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787790632.978010:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787790632.978013:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787790632.978026:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787790632.978261:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790632.978497:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787790632.978513:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787790632.978532:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787790632.978549:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787790632.978563:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787790632.978620:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787790632.978628:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787790632.978641:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787790632.978647:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787790632.978660:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787790632.978665:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787790632.978678:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787790632.978693:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787790632.979095:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787790632.979102:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787790632.979109:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790632.979212:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787790632.979223:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787790632.979238:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787790632.979254:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787790632.979284:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787790632.979296:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787790632.979330:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787790632.979339:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787790632.979351:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787790632.979366:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787790632.979379:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787790632.979388:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787790632.979411:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787790632.979488:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787790632.979506:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787790632.979521:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787790632.979582:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787790632.979604:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787790632.979611:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787790632.990097:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787790632.990376:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787790632.990407:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.122@tcp for mdt 20000000:01000000:0.0:1787790632.990409:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:0.0:1787790632.990505:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787790632.990513:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787790632.990527:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787790632.990532:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:0.0:1787790632.990544:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787790632.990551:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787790632.990564:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787790632.990580:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787790632.990612:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787790632.990615:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787790632.990620:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787790632.990688:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787790632.990691:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787790632.991191:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787790632.991335:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787790632.991358:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787790632.991372:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787790632.991380:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787790632.991382:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787790632.991633:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787790632.991899:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787790632.991915:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787790632.991927:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787790632.991936:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787790632.991939:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787790632.991942:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787790632.991944:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787790632.991948:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787790632.991954:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787790632.992183:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787790632.992260:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787790633.002580:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787790633.002634:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787790633.002651:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787790633.002669:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787790633.002690:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002749:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002761:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002767:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002774:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002780:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002787:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc55a247 already unused, calling callback (0000000066e79be5) 00010000:00010000:0.0:1787790633.002791:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002799:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002810:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002818:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.002833:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc55a247/0xcf9477fddcf1d518 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790633.002853:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787790633.020944:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bf90c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+5:6490:x1874634267951360:12345-0@lo:253: Request processed in 55908us (56972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790633.020961:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790633.020977:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3b2cacc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951360:0@lo:253: 10000000:01000000:1.0:1787790633.020992:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787790633.020995:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790633.020997:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790633.020998:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790633.021000:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787790633.021001:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790633.021002:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790633.021004:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790633.021006:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790633.021007:0:6490:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787790633.021009:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790633.021011:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790633.021030:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000096a53c70 from lustre-MDT0000 10000000:01000000:1.0:1787790633.021072:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787790633.021075:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787790633.021079:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9170d6383370 10000000:01000000:1.0:1787790633.021084:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790633.021091:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9170d6383370 from 1 10000000:01000000:1.0:1787790633.021094:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787790633.021131:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.021142:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.021165:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790633.021183:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ce8cd5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951488:0@lo:101: 00000100:00100000:1.0:1787790633.021221:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790633.021266:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084be0901 going to sleep for 11 seconds 00000100:00100000:0.0:1787790633.021274:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267951488 00000100:00100000:0.0:1787790633.021282:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267951488 00000100:00100000:0.0:1787790633.021331:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790633.021340:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bb10021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+5:6490:x1874634267951488:12345-0@lo:101: 00010000:00010000:0.0:1787790633.021353:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790633.021366:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d51f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.021389:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.021401:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.021409:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5a570c0, rc 0) 00000100:00100000:0.0:1787790633.021450:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bb10021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+6:6490:x1874634267951488:12345-0@lo:101: Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790633.021456:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790633.021488:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ce8cd5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951488:0@lo:101: 00010000:00010000:1.0:1787790633.021500:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.021509:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790633.021558:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ce8cd5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951616:0@lo:501: 00000100:00100000:1.0:1787790633.021583:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790633.021605:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084be0901 going to sleep for 11 seconds 00000100:00100000:0.0:1787790633.021910:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267951616 00000100:00100000:0.0:1787790633.021915:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267951616 00000100:00100000:0.0:1787790633.021945:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790633.021957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff616672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+6:6490:x1874634267951616:12345-0@lo:501: 00000100:00100000:0.0:1787790633.022026:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff616672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+6:6490:x1874634267951616:12345-0@lo:501: Request processed in 69us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790633.022032:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790633.022136:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ce8cd5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951616:0@lo:501: 10000000:01000000:2.0:1787790633.022168:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787790633.022184:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.022192:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790633.022199:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170c2ab0800 10000000:01000000:2.0:1787790633.022204:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787790633.022208:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9170c2ab0800 10000000:01000000:2.0:1787790633.022211:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787790633.022213:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9170c2ab0800 from 1 10000000:01000000:2.0:1787790633.022220:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787790633.022240:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.022246:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.022252:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790633.022264:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951744:0@lo:101: 00000100:00100000:2.0:1787790633.022315:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790633.022346:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a34e59a7 going to sleep for 11 seconds 00000100:00100000:1.0:1787790633.022392:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267951744 00000100:00100000:1.0:1787790633.022397:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267951744 00000100:00100000:1.0:1787790633.022450:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790633.022456:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c40f3b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+6:6490:x1874634267951744:12345-0@lo:101: 00010000:00010000:1.0:1787790633.022464:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790633.022473:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064bc264c/0xcf9477fddcf1d534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d52d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.022488:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064bc264c/0xcf9477fddcf1d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d52d expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.022507:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064bc264c/0xcf9477fddcf1d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d52d expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.022513:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064bc264c, rc 0) 00000100:00100000:1.0:1787790633.022554:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c40f3b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+7:6490:x1874634267951744:12345-0@lo:101: Request processed in 98us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790633.022560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787790633.022930:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951744:0@lo:101: 00010000:00010000:3.0:1787790633.022944:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790633.022951:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790633.022963:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787790633.022966:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790633.022971:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000d6f9b53a/0xcf9477fddcf1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790633.022989:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787790633.022993:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787790633.022997:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9170c2ab0800 10000000:01000000:3.0:1787790633.023000:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787790633.023002:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787790633.023004:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790633.023021:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790633.023028:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790633.023034:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790633.023046:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951872:0@lo:101: 00000100:00100000:3.0:1787790633.023102:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790633.023130:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffe5e40e going to sleep for 11 seconds 00000100:00100000:1.0:1787790633.023173:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267951872 00000100:00100000:1.0:1787790633.023178:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267951872 00000100:00100000:1.0:1787790633.023202:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790633.023208:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000697058fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+7:6490:x1874634267951872:12345-0@lo:101: 00010000:00010000:1.0:1787790633.023215:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790633.023223:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d53b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.023237:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.023245:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.023252:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000affac8bb, rc 0) 00000100:00100000:1.0:1787790633.023289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000697058fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+8:6490:x1874634267951872:12345-0@lo:101: Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790633.023295:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790633.023537:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267951872:0@lo:101: 00010000:00010000:3.0:1787790633.023547:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790633.023555:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790633.023602:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952000:0@lo:501: 00000100:00100000:3.0:1787790633.023625:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790633.023654:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffe5e40e going to sleep for 11 seconds 00000100:00100000:2.0:1787790633.023874:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952000 00000100:00100000:2.0:1787790633.023878:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952000 00000100:00100000:2.0:1787790633.023909:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790633.023915:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f84e7d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+8:6490:x1874634267952000:12345-0@lo:501: 00000100:00100000:2.0:1787790633.024238:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f84e7d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+9:6490:x1874634267952000:12345-0@lo:501: Request processed in 323us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790633.024246:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787790633.024518:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952000:0@lo:501: 00000100:00100000:3.0:1787790633.024546:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952128:0@lo:503: 00000100:00100000:3.0:1787790633.024582:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790633.024608:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffe5e40e going to sleep for 11 seconds 00000100:00100000:2.0:1787790633.024654:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952128 00000100:00100000:2.0:1787790633.024659:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952128 00000100:00100000:2.0:1787790633.024688:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790633.024694:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e43e023d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+9:6490:x1874634267952128:12345-0@lo:503: 00000100:00100000:2.0:1787790633.024963:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e43e023d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+9:6490:x1874634267952128:12345-0@lo:503: Request processed in 269us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790633.024969:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787790633.025038:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952128:0@lo:503: 00000100:00100000:3.0:1787790633.026012:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6534:1874634267952256:0@lo:502: 00000100:00100000:3.0:1787790633.026075:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790633.026113:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa0d3c56 going to sleep for 11 seconds 00000100:00100000:2.0:1787790633.026325:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952256 00000100:00100000:2.0:1787790633.026331:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952256 00000100:00100000:2.0:1787790633.026377:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790633.026384:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008aa13a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+9:6534:x1874634267952256:12345-0@lo:502: 00000100:00100000:2.0:1787790633.026563:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008aa13a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+9:6534:x1874634267952256:12345-0@lo:502: Request processed in 179us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790633.026570:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790633.026674:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6534:1874634267952256:0@lo:502: 00000020:01000000:3.0:1787790633.026701:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790633.027062:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790633.027064:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787790633.027071:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787790633.027074:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790633.027095:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006c9b6774) 00000020:00000080:3.0:1787790633.027115:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787790633.027121:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787790633.027254:0:6534:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787790633.027263:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d550 00000020:00000080:3.0:1787790633.028995:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787790633.029006:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790633.034988:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790633.035000:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787790633.035012:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790633.035027:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790633.035029:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787790633.035034:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790633.035089:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007778c4b5) 00000020:00000080:2.0:1787790633.035126:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787790633.035133:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787790633.035135:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787790633.035137:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787790633.035146:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787790633.035254:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000096a53c70 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787790633.035270:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e002f942) 00000020:00000080:2.0:1787790633.035278:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787790633.035367:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787790633.035376:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d565 00000020:00000080:2.0:1787790633.036661:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787790633.036672:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787790633.036681:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf9477fddcf1d56c 00080000:01000000:2.0:1787790633.036688:0:6534:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787790633.036692:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d573 00080000:10000000:2.0:1787790633.037276:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787790633.038580:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787790633.042821:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787790633.164847:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787790633.165189:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787790633.168955:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787790633.169333:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787790633.174060:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006c053d1d) 00000020:00000080:2.0:1787790633.174090:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787790633.174176:0:6534:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787790633.174183:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d581 00000020:00000080:2.0:1787790633.179144:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787790633.180197:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787790633.187650:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1787790633.193135:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1787790633.197029:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1787790633.200149:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1787790633.203637:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1787790633.206878:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf9477fddcf1d588 00000020:00000080:1.0:1787790633.207134:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787790633.207145:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790633.207151:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790633.207153:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787790633.207156:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790633.207159:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790633.207160:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787790633.207163:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787790633.207165:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787790633.207167:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790633.207169:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790633.207170:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787790633.207172:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790633.207176:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790633.207177:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787790633.207180:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787790633.207224:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787790633.207285:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6534:1874634267952384:0@lo:502: 00000100:00100000:1.0:1787790633.207362:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790633.207426:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084be0901 going to sleep for 11 seconds 00000100:00100000:2.0:1787790633.207669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952384 00000100:00100000:2.0:1787790633.207676:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952384 00000100:00100000:2.0:1787790633.207749:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790633.207757:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023bbe893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+9:6534:x1874634267952384:12345-0@lo:502: 00000100:00100000:2.0:1787790633.207862:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023bbe893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+9:6534:x1874634267952384:12345-0@lo:502: Request processed in 106us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790633.207870:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790633.208018:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6534:1874634267952384:0@lo:502: 00000020:01000000:1.0:1787790633.208043:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790633.208060:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790633.208062:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787790633.208066:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787790633.208234:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787790633.208255:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787790633.208274:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.208285:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790633.208293:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170c2ab0800 from 1 10000000:01000000:0.0:1787790633.208295:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790633.208324:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.208330:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.208339:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790633.208352:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952512:0@lo:101: 00000100:00100000:0.0:1787790633.208381:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790633.208412:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000001891311a going to sleep for 11 seconds 00000100:00100000:1.0:1787790633.208739:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952512 00000100:00100000:1.0:1787790633.208745:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952512 00000100:00100000:1.0:1787790633.208772:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790633.208785:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004791d6b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+9:6490:x1874634267952512:12345-0@lo:101: 00010000:00010000:1.0:1787790633.208796:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790633.208807:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d58f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.208829:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.208841:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.208849:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f405655c, rc 0) 00000100:00100000:1.0:1787790633.208886:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004791d6b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+10:6490:x1874634267952512:12345-0@lo:101: Request processed in 101us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790633.208892:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787790633.209081:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952512:0@lo:101: 00010000:00010000:0.0:1787790633.209094:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.209111:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790633.209996:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952640:0@lo:256: 00000100:00100000:0.0:1787790633.210065:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790633.210142:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000001891311a going to sleep for 11 seconds 00000100:00100000:2.0:1787790633.210628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952640 00000100:00100000:2.0:1787790633.210635:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952640 00000100:00100000:2.0:1787790633.210752:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790633.210761:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003296707b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+10:6490:x1874634267952640:12345-0@lo:256: 20000000:01000000:2.0:1787790633.210781:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787790633.210787:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787790633.210861:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003296707b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+10:6490:x1874634267952640:12345-0@lo:256: Request processed in 102us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790633.210867:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790633.210942:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952640:0@lo:256: 10000000:01000000:0.0:1787790633.211739:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790633.211764:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.211775:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790633.211784:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c2ab0800 from 1 10000000:01000000:0.0:1787790633.211787:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790633.211821:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.211829:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.211837:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790633.211853:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952768:0@lo:101: 00000100:00100000:0.0:1787790633.211895:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790633.212409:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000001891311a going to sleep for 11 seconds 00000100:00100000:1.0:1787790633.212644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952768 00000100:00100000:1.0:1787790633.212651:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952768 00000100:00100000:1.0:1787790633.212690:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790633.212697:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b038006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+10:6490:x1874634267952768:12345-0@lo:101: 00010000:00010000:1.0:1787790633.212734:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790633.212749:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d59d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.212771:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.212781:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.212788:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004bff0330, rc 0) 00000100:00100000:1.0:1787790633.212832:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b038006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6490:x1874634267952768:12345-0@lo:101: Request processed in 136us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790633.212839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790633.212923:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952768:0@lo:101: 00010000:00010000:0.0:1787790633.212936:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.212944:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790633.212997:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952896:0@lo:501: 00000100:00100000:0.0:1787790633.213020:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790633.213044:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000001891311a going to sleep for 11 seconds 00000100:00100000:1.0:1787790633.213097:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267952896 00000100:00100000:1.0:1787790633.213101:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267952896 00000100:00100000:1.0:1787790633.213116:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790633.213120:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db8c00aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6490:x1874634267952896:12345-0@lo:501: 00000100:00100000:1.0:1787790633.213430:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db8c00aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6490:x1874634267952896:12345-0@lo:501: Request processed in 308us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790633.213438:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790633.213673:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267952896:0@lo:501: 00000100:00100000:0.0:1787790633.213731:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953024:0@lo:503: 00000100:00100000:0.0:1787790633.213778:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790633.213795:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000001891311a going to sleep for 11 seconds 00000100:00100000:1.0:1787790633.213921:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953024 00000100:00100000:1.0:1787790633.213925:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953024 00000100:00100000:1.0:1787790633.213945:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790633.213950:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8aa25f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6490:x1874634267953024:12345-0@lo:503: 00000040:00080000:1.0:1787790633.213981:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790633.214015:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8aa25f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6490:x1874634267953024:12345-0@lo:503: Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790633.214021:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790633.214106:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953024:0@lo:503: 00000040:00080000:0.0:1787790633.215505:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787790633.215895:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787790633.215918:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790633.215938:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.215950:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790633.216012:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787790633.216015:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170c2ab0800 10000000:01000000:1.0:1787790633.216018:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170c2ab0800 10000000:01000000:1.0:1787790633.216033:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790633.216039:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170c2ab0800 from 1 10000000:01000000:1.0:1787790633.216041:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787790633.216094:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.216103:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.216111:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790633.216133:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953152:0@lo:101: 00000100:00100000:1.0:1787790633.216215:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790633.216958:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e040af0a going to sleep for 11 seconds 00000100:00100000:0.0:1787790633.217072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953152 00000100:00100000:0.0:1787790633.217080:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953152 00000100:00100000:0.0:1787790633.217174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790633.217184:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9072cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6490:x1874634267953152:12345-0@lo:101: 00010000:00010000:0.0:1787790633.217211:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790633.217301:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d5ab expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.217332:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.217362:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.217371:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4204f41, rc 0) 00000100:00100000:0.0:1787790633.217431:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9072cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953152:12345-0@lo:101: Request processed in 248us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790633.217437:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790633.217584:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953152:0@lo:101: 00010000:00010000:1.0:1787790633.217599:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790633.217608:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790633.217670:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953280:0@lo:501: 00000100:00100000:1.0:1787790633.217699:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790633.218118:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e040af0a going to sleep for 11 seconds 00000100:00100000:3.0:1787790633.218165:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953280 00000100:00100000:3.0:1787790633.218171:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953280 00000100:00100000:3.0:1787790633.218314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790633.218322:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c71d147f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953280:12345-0@lo:501: 00000100:00100000:3.0:1787790633.218649:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c71d147f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953280:12345-0@lo:501: Request processed in 328us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790633.218667:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787790633.218849:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953280:0@lo:501: 00000100:00100000:1.0:1787790633.218889:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953408:0@lo:503: 00000100:00100000:1.0:1787790633.218930:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790633.218963:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e040af0a going to sleep for 11 seconds 00000100:00100000:3.0:1787790633.219770:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953408 00000100:00100000:3.0:1787790633.219778:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953408 00000100:00100000:3.0:1787790633.219811:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787790633.219819:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036f03ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953408:12345-0@lo:503: 00000100:00100000:3.0:1787790633.219945:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036f03ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953408:12345-0@lo:503: Request processed in 125us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790633.219952:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790633.220187:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca101e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953408:0@lo:503: 00000100:00100000:3.0:1787790633.220892:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6539:1874634267953536:0@lo:502: 00000100:00100000:3.0:1787790633.220943:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790633.220978:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfe35108 going to sleep for 11 seconds 00000100:00100000:0.0:1787790633.221038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953536 00000100:00100000:0.0:1787790633.221045:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953536 00000100:00100000:0.0:1787790633.221100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790633.221107:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f74e42b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:6539:x1874634267953536:12345-0@lo:502: 00000100:00100000:0.0:1787790633.221637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f74e42b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:6539:x1874634267953536:12345-0@lo:502: Request processed in 529us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790633.221646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790633.221747:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6539:1874634267953536:0@lo:502: 00000020:01000004:3.0:1787790633.221807:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787790633.221821:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000048cb094e) 00000020:00000080:3.0:1787790633.221839:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787790633.221923:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000096a53c70 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787790633.221927:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000096a53c70 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787790633.221930:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000096a53c70 4 00010000:00080000:3.0:1787790633.221957:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004b6554c7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787790633.225114:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787790633.225629:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787790633.225685:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790633.225786:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf9477fddcf1d5c0 00000100:00080000:0.0:1787790633.225797:0:6539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790633.225804:0:6539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004b6554c7 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790633.225858:0:6539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026d20724 x1874634267953664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790633.225929:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634267953664:0@lo:38: 00000100:00100000:1.0:1787790633.226013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787790633.226100:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787790633.226210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953664 00000100:00100000:2.0:1787790633.226218:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953664 00000100:00100000:2.0:1787790633.226268:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790633.226275:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ca101e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634267953664:12345-0@lo:38: 00000100:00100000:2.0:1787790633.230682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ca101e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634267953664:12345-0@lo:38: Request processed in 4397us (4661us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787790633.230718:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790633.230983:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6539:1874634267953792:0@lo:502: 00000100:00100000:2.0:1787790633.231066:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790633.231097:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a09dfd76 going to sleep for 11 seconds 00000100:00100000:2.0:1787790633.231117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953792 00000100:00100000:2.0:1787790633.231125:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953792 00000100:00100000:2.0:1787790633.231169:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787790633.231176:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8935a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:6539:x1874634267953792:12345-0@lo:502: 00000100:00100000:2.0:1787790633.232616:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8935a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:6539:x1874634267953792:12345-0@lo:502: Request processed in 1433us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790633.232631:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787790633.232724:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:6539:1874634267953792:0@lo:502: 00000040:00080000:2.0:1787790633.232761:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787790633.232998:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787790633.233022:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790633.233055:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.233072:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787790633.233123:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787790633.233125:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790633.233126:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790633.233128:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790633.233129:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790633.233131:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790633.233132:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790633.233133:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790633.233135:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790633.233136:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790633.233138:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790633.233139:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790633.233144:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787790633.233146:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790633.233147:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787790633.233149:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790633.233150:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790633.233151:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790633.233152:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790633.233152:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790633.233154:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787790633.233154:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790633.233155:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790633.233156:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790633.233157:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790633.233177:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787790633.233190:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953920:0@lo:253: 00000100:00100000:0.0:1787790633.233680:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790633.233749:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267953920 00000100:00100000:0.0:1787790633.233756:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267953920 00000100:00100000:0.0:1787790633.233795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790633.233802:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002985975c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953920:12345-0@lo:253: 20000000:01000000:0.0:1787790633.233837:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787790633.233850:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787790633.234415:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790633.234427:0:3637:0:(import.c:65:import_set_state_nolock()) 000000004b6554c7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790633.234432:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787790633.234436:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634267953664:0@lo:38: 00000100:00100000:0.0:1787790633.234871:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc24ee7e going to sleep for 11 seconds 20000000:01000000:0.0:1787790633.240652:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787790633.240679:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787790633.240963:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790633.240968:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790633.240993:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.241013:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.241021:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.241075:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.241091:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790633.241120:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267954048:0@lo:104: 00000100:00100000:2.0:1787790633.241216:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790633.241347:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a09dfd76 going to sleep for 11 seconds 00000100:00100000:3.0:1787790633.241537:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954048 00000100:00100000:3.0:1787790633.241545:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954048 00000100:00100000:3.0:1787790633.241592:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790633.241599:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cc52500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267954048:12345-0@lo:104: 00010000:00010000:3.0:1787790633.241612:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790633.241673:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790633.241685:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cc52500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267954048:12345-0@lo:104: Request processed in 86us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790633.241693:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787790633.241861:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790633.241866:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.241875:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc55a247 already unused, calling callback (00000000faf0a9d0) 10000000:00010000:0.0:1787790633.241878:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.241885:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790633.241892:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790633.241897:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790633.241922:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.241928:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790633.241941:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.241947:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 00000000cc55a247/0xcf9477fddcf1d58f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d596 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.241962:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790633.241968:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790633.241970:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790633.242125:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025985ffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267954176:0@lo:103: 00000100:00100000:2.0:1787790633.242156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790633.242314:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267954048:0@lo:104: 00010000:00010000:2.0:1787790633.242332:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790633.242592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002985975c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:6490:x1874634267953920:12345-0@lo:253: Request processed in 8789us (8913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790633.242601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790633.242675:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954176 00000100:00100000:0.0:1787790633.242680:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954176 00010000:00010000:0.0:1787790633.242699:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790633.242749:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790633.242755:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000331e9eb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+12:3639:x1874634267954176:12345-0@lo:103: 00010000:00010000:0.0:1787790633.242766:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790633.242770:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242780:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242794:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d58f expref: 12 pid: 6506 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242808:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242815:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790633.242829:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001860386s 00010000:00010000:0.0:1787790633.242832:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242839:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242858:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242865:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242870:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000122f8210 already unused, calling callback (0000000066e79be5) 00010000:00010000:0.0:1787790633.242872:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242878:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242888:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790633.242896:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790633.242920:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000331e9eb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+11:3639:x1874634267954176:12345-0@lo:103: Request processed in 166us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790633.242926:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790633.243026:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025985ffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267954176:0@lo:103: 00010000:00010000:2.0:1787790633.243044:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.243060:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790633.243066:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000122f8210/0xcf9477fddcf1d5c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790633.243098:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:6490:1874634267953920:0@lo:253: 10000000:01000000:2.0:1787790633.243108:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787790633.243111:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790633.243113:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787790633.243114:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790633.243116:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790633.243117:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790633.243118:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790633.243119:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790633.243126:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787790633.243128:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787790633.243129:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787790633.243131:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790633.243132:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787790633.243142:0:6490:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787790633.250322:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787790633.250699:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787790633.250954:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787790633.251114:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787790633.251687:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787790633.251959:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787790633.254367:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1787790633.255014:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787790633.255540:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787790633.255784:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787790633.255981:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787790633.256156:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1787790633.259679:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787790633.272204:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787790633.272638:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787790633.274002:0:6544:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787790633.274009:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787790633.275529:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787790633.275669:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787790633.278533:0:6490:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787790633.278557:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787790633.280153:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790633.281253:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787790633.282660:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787790633.282751:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787790633.285544:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790633.285921:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787790633.286587:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1787790633.288667:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787790633.288852:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787790633.288994:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787790633.289165:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787790633.289633:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787790633.289995:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787790633.294146:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787790633.294876:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787790633.295020:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787790633.295174:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787790633.295447:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787790633.296199:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787790633.296364:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787790633.296690:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787790633.296994:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787790633.297153:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787790633.297981:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787790633.298154:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787790633.298425:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787790633.298640:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787790633.299019:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787790633.299182:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787790633.299526:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787790633.299668:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787790633.300073:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787790633.300910:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787790633.301914:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787790633.302109:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787790633.302955:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787790633.303167:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787790633.304098:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787790633.305585:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787790633.307356:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787790633.307676:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787790633.307839:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787790633.307844:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1787790633.318774:0:6490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787790633.318818:0:6490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8b301c97988 00100000:10000000:3.0:1787790633.318827:0:6490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787790633.319512:0:6490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787790633.319527:0:6490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787790633.319547:0:6490:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787790633.319572:0:6490:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787790633.320322:0:6490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790633.320516:0:6490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787790633.802991:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790634.826840:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790635.850991:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790636.875519:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790637.905152:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790637.961150:0:6790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787790638.411104:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef73bebb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267954304:0@lo:400: 00000100:00100000:1.0:1787790638.411231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787790638.411319:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787790638.411324:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787790638.411326:0:38:0:(import.c:65:import_set_state_nolock()) 000000004b6554c7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790638.411336:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004b6554c7 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790638.411360:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cbdd2024 x1874634267954432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790638.413983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954304 00000100:00100000:1.0:1787790638.413997:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954304 00000100:00100000:1.0:1787790638.414064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790638.414073:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000564ce487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+11:3640:x1874634267954304:12345-0@lo:400: 00000100:00100000:1.0:1787790638.414188:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000564ce487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+11:3640:x1874634267954304:12345-0@lo:400: Request processed in 108us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790638.414196:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790638.414237:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd2024 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634267954432:0@lo:38: 00000100:00100000:1.0:1787790638.414292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790638.414342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954432 00000100:00100000:1.0:1787790638.414358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954432 00000100:00100000:1.0:1787790638.414564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790638.414569:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8fba8c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634267954432:12345-0@lo:38: 00010000:00080000:1.0:1787790638.414600:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1787790638.414737:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf9477fddcf1d5ce 00000004:00100000:1.0:1787790638.414789:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787790638.415069:0:6514:0:(import.c:65:import_set_state_nolock()) 000000002b9abb92 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790638.415120:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8fba8c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874634267954432:12345-0@lo:38: Request processed in 549us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790638.415127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787790638.415610:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cbdd2024 x1874634267954432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790638.415630:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787790638.415638:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787790638.415655:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790638.415657:0:3637:0:(import.c:65:import_set_state_nolock()) 000000004b6554c7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790638.415664:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbdd2024 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634267954432:0@lo:38: 00000100:00100000:1.0:1787790638.415701:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef73bebb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267954304:0@lo:400: 00000020:00000004:3.0:1787790638.862544:0:6842:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790638.862770:0:6842:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787790638.937947:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787790639.946923:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787790639.946932:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170c2ab0800 from 3 10000000:01000000:2.0:1787790639.946937:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787790639.946994:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790639.947008:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790639.947018:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790639.947044:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099adad84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267954560:0@lo:101: 00000100:00100000:2.0:1787790639.947123:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790639.947204:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a2e73d2 going to sleep for 11 seconds 00000100:00100000:3.0:1787790639.947214:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954560 00000100:00100000:3.0:1787790639.947223:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954560 00000100:00100000:3.0:1787790639.947288:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790639.947296:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220e4c25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+11:6509:x1874634267954560:12345-0@lo:101: 00010000:00010000:3.0:1787790639.947313:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790639.947326:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d5d5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790639.947347:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790639.947357:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790639.947366:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006742a8e9, rc 0) 00000100:00100000:3.0:1787790639.947411:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220e4c25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:6509:x1874634267954560:12345-0@lo:101: Request processed in 115us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1787790639.947414:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790639.947420:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787790639.947604:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099adad84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267954560:0@lo:101: 00010000:00010000:2.0:1787790639.947622:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790639.947631:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790639.947692:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099adad84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267954688:0@lo:256: 00000100:00100000:2.0:1787790639.947745:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790639.947773:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a2e73d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787790639.947886:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954688 00000100:00100000:0.0:1787790639.947890:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954688 00000100:00100000:0.0:1787790639.947925:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787790639.947932:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ce8a67e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+12:6509:x1874634267954688:12345-0@lo:256: 20000000:01000000:0.0:1787790639.947949:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790639.947965:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790639.947968:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787790639.948062:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ce8a67e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+12:6509:x1874634267954688:12345-0@lo:256: Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790639.948070:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787790639.948247:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099adad84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267954688:0@lo:256: 10000000:01000000:2.0:1787790639.948288:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790639.948293:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790639.948301:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790640.971006:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787790641.563580:0:6944:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790641.564141:0:6944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787790641.999739:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790643.039725:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790643.535203:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267954816:0@lo:400: 00000100:00100000:3.0:1787790643.535276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790643.535343:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634267954944:0@lo:400: 00000100:00100000:3.0:1787790643.535420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790643.536317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954944 00000100:00100000:2.0:1787790643.536326:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954944 00000100:00100000:2.0:1787790643.536380:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790643.536388:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b839309 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634267954944:12345-0@lo:400: 00000100:00100000:2.0:1787790643.536453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b839309 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634267954944:12345-0@lo:400: Request processed in 66us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790643.536460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787790643.536806:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bc13f776 x1874634267954944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790643.536823:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634267954944:0@lo:400: 00000100:00100000:1.0:1787790643.542453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267954816 00000100:00100000:1.0:1787790643.542468:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267954816 00000100:00100000:1.0:1787790643.542540:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790643.542548:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071351190 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:3641:x1874634267954816:12345-0@lo:400: 00000100:00100000:1.0:1787790643.544098:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071351190 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:3641:x1874634267954816:12345-0@lo:400: Request processed in 1545us (8817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790643.544689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790643.544928:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267954816:0@lo:400: 00010000:00010000:1.0:1787790644.043145:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790645.069272:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790646.098804:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790647.114856:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790648.140285:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790648.651969:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e960367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267955072:0@lo:400: 00000100:00100000:0.0:1787790648.652041:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790648.652151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955072 00000100:00100000:1.0:1787790648.652167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955072 00000100:00100000:1.0:1787790648.652221:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790648.652229:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df82e207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:3639:x1874634267955072:12345-0@lo:400: 00000100:00100000:3.0:1787790648.654028:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790648.654125:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099adad84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267955200:0@lo:400: 00000100:00100000:3.0:1787790648.654197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790648.654321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955200 00000100:00100000:2.0:1787790648.654330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955200 00000100:00100000:2.0:1787790648.654372:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790648.654379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d05bf3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267955200:12345-0@lo:400: 00000100:00100000:2.0:1787790648.654424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d05bf3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267955200:12345-0@lo:400: Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790648.654430:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790648.654494:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000099adad84 x1874634267955200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790648.654506:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099adad84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267955200:0@lo:400: 00000100:00100000:1.0:1787790648.654666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df82e207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:3639:x1874634267955072:12345-0@lo:400: Request processed in 2437us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790648.654673:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790648.654902:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e960367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267955072:0@lo:400: 00010000:00010000:2.0:1787790649.167932:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787790649.551634:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790649.551638:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787790649.551639:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787790649.551818:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a6057164 00000020:01000004:2.0:1787790649.551835:0:7442:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787790649.551853:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787790649.551867:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b4e37c1c) 00000020:00000080:2.0:1787790649.551880:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787790649.604567:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787790649.604627:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1787790649.627002:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787790649.627273:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787790649.627283:0:7442:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790649.627293:0:7442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1d5ea 00000020:01000004:2.0:1787790649.627299:0:7442:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787790649.627320:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787790649.627323:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787790649.627329:0:7442:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787790649.627352:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787790649.627356:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787790649.648040:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787790649.648154:0:7442:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787790649.648158:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787790649.648160:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787790649.648161:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790649.648163:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790649.648164:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790649.648165:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790649.648166:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787790649.648168:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790649.648169:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790649.648171:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790649.648172:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790649.648176:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787790649.648178:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790649.648180:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787790649.648181:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790649.648182:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790649.648183:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790649.648184:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790649.648185:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787790649.648186:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790649.648187:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790649.648188:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790649.648189:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790649.648215:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787790649.648234:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267955328:0@lo:253: 00000100:00100000:3.0:1787790649.648308:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.648402:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000870a0670 going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.648447:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955328 00000100:00100000:1.0:1787790649.648454:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955328 00000100:00100000:1.0:1787790649.648542:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790649.648552:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca9640b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267955328:12345-0@lo:253: 20000000:01000000:1.0:1787790649.648591:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787790649.648596:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1787790649.648601:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1787790649.648605:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1787790649.648637:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1787790649.649197:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790649.649329:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787790649.649343:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790649.649360:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787790649.649376:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787790649.649390:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787790649.649441:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1787790649.649450:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1787790649.649464:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1787790649.649470:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1787790649.649484:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1787790649.649497:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1787790649.649514:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787790649.649530:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787790649.649643:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1787790649.649653:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790649.649666:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1787790649.649671:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790649.649684:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1787790649.649690:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790649.649860:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1787790649.649869:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787790649.649885:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787790649.649914:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787790649.649927:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787790649.650012:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1787790649.650021:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1787790649.650033:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787790649.650064:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787790649.650084:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1787790649.650091:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1787790649.650105:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787790649.650127:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787790649.650132:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1787790649.650152:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787790649.650159:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787790649.651399:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787790649.651697:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787790649.651977:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.122@tcp for mdt 20000000:01000000:1.0:1787790649.651980:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790649.651998:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787790649.652004:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787790649.652027:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787790649.652034:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790649.652126:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787790649.652136:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787790649.652151:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787790649.652168:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787790649.652218:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787790649.652226:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787790649.652545:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1787790649.653138:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787790649.653162:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.122@tcp for mdt 20000000:01000000:1.0:1787790649.653165:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790649.653180:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787790649.653185:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790649.653196:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787790649.653201:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790649.653213:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787790649.653219:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1787790649.653231:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787790649.653246:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1787790649.653265:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787790649.653268:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787790649.653272:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787790649.653319:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787790649.653322:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787790649.653683:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787790649.653928:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787790649.653952:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787790649.654194:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787790649.654216:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787790649.654241:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787790649.654251:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787790649.654253:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787790649.654656:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787790649.654674:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787790649.654690:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787790649.655120:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787790649.655142:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787790649.655172:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787790649.655184:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787790649.655186:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787790649.655452:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787790649.655471:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787790649.655487:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1787790649.655691:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787790649.655919:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787790649.655941:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1787790649.655954:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787790649.655956:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787790649.655961:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787790649.655967:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787790649.656300:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787790649.656415:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787790649.666816:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787790649.667065:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667088:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667095:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667100:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667106:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667160:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667173:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 12 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.667185:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267955456:0@lo:104: 00000100:00100000:0.0:1787790649.667253:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790649.667311:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667319:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 12 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.667326:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a5a8fbd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267955584:0@lo:104: 00000100:00100000:0.0:1787790649.667347:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790649.667371:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.667378:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 12 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.667386:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7f4de92 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267955712:0@lo:104: 00000100:00100000:0.0:1787790649.667404:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.667413:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set 000000002028e820 going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.667547:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955456 00000100:00100000:3.0:1787790649.667555:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955456 00000100:00100000:3.0:1787790649.667604:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955584 00000100:00100000:3.0:1787790649.667607:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955584 00000100:00100000:3.0:1787790649.667617:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955712 00000100:00100000:3.0:1787790649.667620:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955712 00000100:00100000:3.0:1787790649.667633:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790649.667639:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001118e5a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:6505:x1874634267955456:12345-0@lo:104: 00010000:00010000:3.0:1787790649.667650:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.667731:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790649.667736:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001118e5a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:6505:x1874634267955456:12345-0@lo:104: Request processed in 97us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.667743:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790649.667758:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790649.667764:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b65e138c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6505:x1874634267955584:12345-0@lo:104: 00010000:00010000:3.0:1787790649.667781:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.667827:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787790649.667832:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b65e138c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6505:x1874634267955584:12345-0@lo:104: Request processed in 69us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.667837:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790649.667862:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790649.667868:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b2fcc56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:6505:x1874634267955712:12345-0@lo:104: 00010000:00010000:3.0:1787790649.667874:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.667910:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787790649.667915:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b2fcc56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:6505:x1874634267955712:12345-0@lo:104: Request processed in 48us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.667920:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787790649.667935:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787790649.667940:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.667947:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000036cac710 already unused, calling callback (00000000faf0a9d0) 10000000:00010000:3.0:1787790649.667950:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.667957:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790649.667963:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790649.667968:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790649.668048:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668055:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790649.668073:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668079:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d5ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668090:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790649.668092:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668097:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002770ee6f already unused, calling callback (00000000faf0a9d0) 10000000:00010000:3.0:1787790649.668099:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668105:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790649.668109:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790649.668114:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790649.668124:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668130:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790649.668143:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668157:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 000000002770ee6f/0xcf9477fddcf1d53b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d542 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668168:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790649.668170:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668175:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007026931b already unused, calling callback (00000000faf0a9d0) 10000000:00010000:3.0:1787790649.668177:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668182:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790649.668187:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790649.668192:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790649.668203:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668208:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790649.668212:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668217:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 000000007026931b/0xcf9477fddcf1d51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d526 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668230:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790649.668236:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790649.668238:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790649.668258:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000029f8008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267955840:0@lo:103: 00000100:00100000:3.0:1787790649.668289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.668328:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267955968:0@lo:103: 00000100:00100000:3.0:1787790649.668350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.668366:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790649.668371:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267956096:0@lo:103: 00000100:00100000:3.0:1787790649.668390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.668415:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955840 00000100:00100000:3.0:1787790649.668419:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955840 00010000:00010000:3.0:1787790649.668435:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 13 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790649.668450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267955968 00000100:00100000:3.0:1787790649.668453:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267955968 00010000:00010000:3.0:1787790649.668461:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790649.668471:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956096 00000100:00100000:3.0:1787790649.668473:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956096 00010000:00010000:3.0:1787790649.668480:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 15 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790649.668490:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790649.668495:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc13f776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+15:3641:x1874634267955840:12345-0@lo:103: 00010000:00010000:3.0:1787790649.668517:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790649.668522:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 15 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668539:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 15 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668555:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790649.668581:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc13f776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+15:3641:x1874634267955840:12345-0@lo:103: Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.668587:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790649.668600:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790649.668605:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbdd2024 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+14:3638:x1874634267955968:12345-0@lo:103: 00010000:00010000:3.0:1787790649.668612:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790649.668616:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668623:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668632:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790649.668654:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbdd2024 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+14:3638:x1874634267955968:12345-0@lo:103: Request processed in 49us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.668659:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790649.668669:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790649.668675:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef73bebb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+13:3638:x1874634267956096:12345-0@lo:103: 00010000:00010000:3.0:1787790649.668681:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790649.668684:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 13 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668691:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 13 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668738:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668746:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668758:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668765:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668770:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668775:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668781:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c4fc0f2 already unused, calling callback (0000000066e79be5) 00010000:00010000:3.0:1787790649.668784:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668790:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668797:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.668805:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790649.668826:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef73bebb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+13:3638:x1874634267956096:12345-0@lo:103: Request processed in 152us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.668841:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790649.668881:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000029f8008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267955840:0@lo:103: 00000100:00100000:3.0:1787790649.668920:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267956096:0@lo:103: 00000100:00100000:3.0:1787790649.668927:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267955968:0@lo:103: 00010000:00010000:0.0:1787790649.669153:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d5b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d5ab expref: 12 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.669166:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267955456:0@lo:104: 00010000:00010000:0.0:1787790649.669185:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000affac8bb/0xcf9477fddcf1d542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d53b expref: 11 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.669192:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a5a8fbd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267955584:0@lo:104: 00010000:00010000:0.0:1787790649.669198:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c5a570c0/0xcf9477fddcf1d526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d51f expref: 10 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.669205:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7f4de92 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267955712:0@lo:104: 00010000:00010000:0.0:1787790649.669219:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.669227:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.669232:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.669238:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d5f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790649.669251:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:2.0:1787790649.671765:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790649.672110:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca9640b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+9:7442:x1874634267955328:12345-0@lo:253: Request processed in 23555us (23797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.672125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787790649.672271:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267955328:0@lo:253: 10000000:01000000:2.0:1787790649.672287:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787790649.672290:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790649.672292:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787790649.672294:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790649.672295:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787790649.672296:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790649.672297:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790649.672299:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790649.672300:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787790649.672302:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790649.672304:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787790649.672329:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a6057164 from lustre-MDT0001 10000000:01000000:2.0:1787790649.672366:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787790649.672369:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787790649.672391:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9170d6383370 local copy 10000000:01000000:2.0:1787790649.672395:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787790649.672444:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.672456:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.672465:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.672483:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956224:0@lo:101: 00000100:00100000:2.0:1787790649.672516:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.672596:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000361505f5 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.673514:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956224 00000100:00100000:0.0:1787790649.673523:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956224 00000100:00100000:1.0:1787790649.673686:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787790649.673695:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001540550c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+9:7442:x1874634267956224:12345-0@lo:101: 00010000:00010000:1.0:1787790649.673731:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790649.673744:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d5ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d5f8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.673767:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5f8 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.673786:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5f8 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.673794:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f405655c, rc 0) 00000100:00100000:1.0:1787790649.673851:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001540550c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+10:7442:x1874634267956224:12345-0@lo:101: Request processed in 158us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.673856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790649.674029:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956224:0@lo:101: 00010000:00010000:2.0:1787790649.674043:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.674063:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.674166:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956352:0@lo:501: 00000100:00100000:2.0:1787790649.674197:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.674230:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000361505f5 going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.674723:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956352 00000100:00100000:1.0:1787790649.674730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956352 00000100:00100000:1.0:1787790649.674764:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790649.674779:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea609799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+10:7442:x1874634267956352:12345-0@lo:501: 00000100:00100000:1.0:1787790649.674855:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea609799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+10:7442:x1874634267956352:12345-0@lo:501: Request processed in 84us (658us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790649.674862:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790649.674892:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956352:0@lo:501: 10000000:01000000:1.0:1787790649.674915:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787790649.674931:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787790649.674936:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.674943:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.674949:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.674967:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787790649.674992:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170f3e20800 10000000:01000000:1.0:1787790649.674997:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787790649.675002:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9170d6383370 10000000:01000000:1.0:1787790649.675004:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787790649.675008:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9170d6383370 from 1 10000000:01000000:1.0:1787790649.675010:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787790649.675031:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675117:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675124:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790649.675137:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956480:0@lo:101: 00000100:00100000:1.0:1787790649.675162:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.675177:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4d107eb going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.675196:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956480 00000100:00100000:1.0:1787790649.675199:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956480 00000100:00100000:1.0:1787790649.675214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790649.675219:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008b60dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+10:7442:x1874634267956480:12345-0@lo:101: 00010000:00010000:1.0:1787790649.675225:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790649.675233:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006aaf6e5b/0xcf9477fddcf1d60d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d606 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675247:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006aaf6e5b/0xcf9477fddcf1d60d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d606 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675255:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006aaf6e5b/0xcf9477fddcf1d60d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d606 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675262:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006aaf6e5b, rc 0) 00000100:00100000:1.0:1787790649.675288:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008b60dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+11:7442:x1874634267956480:12345-0@lo:101: Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.675293:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790649.675314:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956480:0@lo:101: 00010000:00010000:1.0:1787790649.675330:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675336:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790649.675348:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787790649.675356:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675362:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 000000001e3f7da8/0xcf9477fddcf1d606 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790649.675369:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9170f3e20800 10000000:01000000:1.0:1787790649.675373:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787790649.675375:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9170f3e20800 from 1 10000000:01000000:1.0:1787790649.675377:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787790649.675388:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675394:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675399:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790649.675409:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956608:0@lo:101: 00000100:00100000:1.0:1787790649.675431:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.675438:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4d107eb going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.675453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956608 00000100:00100000:1.0:1787790649.675461:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956608 00000100:00100000:1.0:1787790649.675475:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790649.675479:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd311027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+11:7442:x1874634267956608:12345-0@lo:101: 00010000:00010000:1.0:1787790649.675485:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790649.675491:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2cdc4e7/0xcf9477fddcf1d61b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d614 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675502:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2cdc4e7/0xcf9477fddcf1d61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d614 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675508:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2cdc4e7/0xcf9477fddcf1d61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d614 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675513:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2cdc4e7, rc 0) 00000100:00100000:1.0:1787790649.675536:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd311027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267956608:12345-0@lo:101: Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.675541:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790649.675559:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956608:0@lo:101: 00010000:00010000:1.0:1787790649.675567:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675941:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790649.675953:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787790649.675956:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.675961:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 0000000077b03359/0xcf9477fddcf1d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790649.675975:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787790649.675978:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790649.675982:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9170f3e20800 10000000:01000000:1.0:1787790649.675984:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787790649.675987:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787790649.675989:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787790649.676001:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.676008:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.676015:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790649.676026:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956736:0@lo:101: 00000100:00100000:1.0:1787790649.676111:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.676133:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4d107eb going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.676156:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956736 00000100:00100000:1.0:1787790649.676160:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956736 00000100:00100000:1.0:1787790649.676179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790649.676185:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049a0d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267956736:12345-0@lo:101: 00010000:00010000:1.0:1787790649.676193:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790649.676199:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079062897/0xcf9477fddcf1d629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d622 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.676211:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079062897/0xcf9477fddcf1d629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.676227:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079062897/0xcf9477fddcf1d629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.676234:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079062897, rc 0) 00000100:00100000:1.0:1787790649.676263:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049a0d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:7442:x1874634267956736:12345-0@lo:101: Request processed in 78us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.676268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790649.676296:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956736:0@lo:101: 00010000:00010000:1.0:1787790649.676306:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.676312:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790649.676379:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956864:0@lo:501: 00000100:00100000:1.0:1787790649.676402:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.676410:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4d107eb going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.676426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956864 00000100:00100000:1.0:1787790649.676429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956864 00000100:00100000:1.0:1787790649.676444:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790649.676448:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e41ff89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:7442:x1874634267956864:12345-0@lo:501: 00000100:00100000:1.0:1787790649.676530:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e41ff89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:7442:x1874634267956864:12345-0@lo:501: Request processed in 81us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.676537:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790649.676557:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267956864:0@lo:501: 00010000:00010000:2.0:1787790649.676750:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790649.676756:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.676764:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043958c37 already unused, calling callback (00000000faf0a9d0) 10000000:00010000:2.0:1787790649.676766:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.676788:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790649.676795:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790649.676799:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790649.676816:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.676820:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790649.676850:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.676856:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d5ff expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.676869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790649.676870:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790649.676871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790649.677034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267956992:0@lo:103: 00000100:00100000:0.0:1787790649.677077:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.677198:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267957120:0@lo:503: 00000100:00100000:1.0:1787790649.677238:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.677297:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267956992 00000100:00100000:2.0:1787790649.677302:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267956992 00000100:00100000:2.0:1787790649.677334:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790649.677341:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f4de92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+13:3640:x1874634267956992:12345-0@lo:103: 00010000:00010000:2.0:1787790649.677350:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790649.677363:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f405655c/0xcf9477fddcf1d5ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d5f8 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.677376:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790649.677413:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f4de92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+12:3640:x1874634267956992:12345-0@lo:103: Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790649.677420:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790649.677461:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4d107eb going to sleep for 11 seconds 00000100:00100000:1.0:1787790649.677480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957120 00000100:00100000:1.0:1787790649.677484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957120 00000100:00100000:2.0:1787790649.677801:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267956992:0@lo:103: 00000100:00100000:0.0:1787790649.677968:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790649.677977:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d38d7daf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267957120:12345-0@lo:503: 00000100:00100000:0.0:1787790649.678090:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d38d7daf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267957120:12345-0@lo:503: Request processed in 115us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.678103:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787790649.678165:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31deee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267957120:0@lo:503: 00000040:00080000:2.0:1787790649.678397:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787790649.678468:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267957248:0@lo:502: 00000100:00100000:2.0:1787790649.678499:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.678528:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a776d65d going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.678668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957248 00000100:00100000:0.0:1787790649.678672:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957248 00000100:00100000:0.0:1787790649.678701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790649.678728:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0f6eab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267957248:12345-0@lo:502: 00000100:00100000:0.0:1787790649.678799:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0f6eab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267957248:12345-0@lo:502: Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.678805:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787790649.678984:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267957248:0@lo:502: 00000040:00080000:2.0:1787790649.679155:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787790649.679186:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787790649.679198:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787790649.679207:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787790649.679218:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787790649.679229:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787790649.679243:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787790649.679253:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787790649.679264:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787790649.679276:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787790649.679288:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787790649.679299:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787790649.679309:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787790649.679321:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787790649.679333:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787790649.679344:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787790649.679357:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787790649.679380:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787790649.679393:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787790649.679415:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787790649.679427:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787790649.679440:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787790649.679452:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787790649.679474:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267957376:0@lo:502: 00000100:00100000:2.0:1787790649.679509:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.679532:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a776d65d going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.679666:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957376 00000100:00100000:0.0:1787790649.679670:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957376 00000100:00100000:0.0:1787790649.679700:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787790649.679725:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070c1c84c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267957376:12345-0@lo:502: 00000100:00100000:0.0:1787790649.679796:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070c1c84c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+12:7442:x1874634267957376:12345-0@lo:502: Request processed in 72us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.679802:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787790649.679980:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267957376:0@lo:502: 00000040:00080000:2.0:1787790649.680020:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1787790649.680028:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1787790649.680565:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790649.680582:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790649.680584:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787790649.680587:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787790649.680589:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790649.680606:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000056ae3db2) 00000020:00000080:2.0:1787790649.680619:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1787790649.680623:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787790649.680691:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787790649.680695:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1d637 00000020:00000080:2.0:1787790649.681252:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787790649.681257:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790649.681260:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790649.681262:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787790649.681264:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790649.681268:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790649.681269:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787790649.681272:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790649.681278:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009c4327f9) 00000020:00000080:2.0:1787790649.681289:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1787790649.681293:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787790649.681299:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787790649.681302:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787790649.681307:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787790649.681363:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a6057164 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787790649.681375:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000e6b19321) 00000020:00000080:2.0:1787790649.681384:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1787790649.681446:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787790649.681452:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d64c 00000020:00000080:2.0:1787790649.681534:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787790649.681542:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787790649.681546:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf9477fddcf1d653 00080000:01000000:2.0:1787790649.681552:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787790649.681555:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1d65a 00080000:10000000:2.0:1787790649.686689:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787790649.686968:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 10000000:01000000:2.0:1787790649.756367:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790649.756376:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170c2ab0800 from 21 10000000:01000000:2.0:1787790649.756381:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790649.756418:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.756431:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.756442:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.756466:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267957504:0@lo:101: 00000100:00100000:2.0:1787790649.756538:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.756599:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000251bc876 going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.756818:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957504 00000100:00100000:3.0:1787790649.756827:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957504 00000100:00100000:3.0:1787790649.756888:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790649.756896:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a34a6866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+12:6509:x1874634267957504:12345-0@lo:101: 00010000:00010000:3.0:1787790649.756917:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790649.756929:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002770ee6f/0xcf9477fddcf1d668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d661 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.756967:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002770ee6f/0xcf9477fddcf1d668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.756978:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002770ee6f/0xcf9477fddcf1d668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.756987:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002770ee6f, rc 0) 00000100:00100000:3.0:1787790649.757035:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a34a6866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+13:6509:x1874634267957504:12345-0@lo:101: Request processed in 140us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.757042:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787790649.757241:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267957504:0@lo:101: 00010000:00010000:2.0:1787790649.757264:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.757272:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.757350:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267957632:0@lo:501: 00000100:00100000:2.0:1787790649.757375:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.757403:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000251bc876 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.757458:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957632 00000100:00100000:0.0:1787790649.757463:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957632 00000100:00100000:0.0:1787790649.757493:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790649.757499:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006af0e8a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+13:6509:x1874634267957632:12345-0@lo:501: 00000100:00100000:0.0:1787790649.757615:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006af0e8a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+13:6509:x1874634267957632:12345-0@lo:501: Request processed in 115us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.757621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787790649.757729:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267957632:0@lo:501: 00000100:00100000:2.0:1787790649.757756:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267957760:0@lo:503: 00000100:00100000:2.0:1787790649.757805:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.757821:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000251bc876 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.757928:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957760 00000100:00100000:0.0:1787790649.757933:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957760 00000100:00100000:0.0:1787790649.757966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787790649.757972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000edad542 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:6509:x1874634267957760:12345-0@lo:503: 00000100:00100000:0.0:1787790649.759221:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000edad542 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:6509:x1874634267957760:12345-0@lo:503: Request processed in 1244us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.759233:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787790649.759401:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267957760:0@lo:503: 00000100:00100000:2.0:1787790649.763531:0:7455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7455:1874634267957888:0@lo:502: 00000100:00100000:2.0:1787790649.763622:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.763728:0:7455:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032768498 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.764932:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267957888 00000100:00100000:0.0:1787790649.764942:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267957888 00000100:00100000:0.0:1787790649.765046:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790649.765056:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bc10ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+13:7455:x1874634267957888:12345-0@lo:502: 00000100:00100000:0.0:1787790649.765217:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bc10ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+13:7455:x1874634267957888:12345-0@lo:502: Request processed in 163us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.765225:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787790649.765439:0:7455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e11fc2f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7455:1874634267957888:0@lo:502: 00000100:00100000:3.0:1787790649.765502:0:7455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7455:1874634267958016:0@lo:502: 00000100:00100000:3.0:1787790649.765542:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.765641:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958016 00000100:00100000:2.0:1787790649.765646:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958016 00000100:00100000:2.0:1787790649.765669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790649.765674:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091ed5576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:7455:x1874634267958016:12345-0@lo:502: 00000100:00100000:2.0:1787790649.765769:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091ed5576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:7455:x1874634267958016:12345-0@lo:502: Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790649.765790:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790649.766073:0:7455:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e6250a7 going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.766089:0:7455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7455:1874634267958016:0@lo:502: 00000040:00080000:3.0:1787790649.766115:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787790649.766302:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787790649.766323:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787790649.766339:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.766351:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 0000000043958c37/0xcf9477fddcf1d661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790649.766361:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787790649.766364:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787790649.766368:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787790649.766393:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.766401:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.766409:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.766423:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfa46f2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267958144:0@lo:101: 00000100:00100000:2.0:1787790649.766455:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.766485:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b656765c going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.766543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958144 00000100:00100000:0.0:1787790649.766548:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958144 00000100:00100000:0.0:1787790649.766580:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790649.766588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005600a939 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+13:6509:x1874634267958144:12345-0@lo:101: 00010000:00010000:0.0:1787790649.766597:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790649.766607:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d66f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.766626:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.766636:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c4fc0f2/0xcf9477fddcf1d676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.766644:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c4fc0f2, rc 0) 00000100:00100000:0.0:1787790649.766683:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005600a939 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267958144:12345-0@lo:101: Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.766689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787790649.767174:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfa46f2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267958144:0@lo:101: 00010000:00010000:3.0:1787790649.767189:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.767198:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790649.767267:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267958272:0@lo:501: 00000100:00100000:3.0:1787790649.767295:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.767326:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e6250a7 going to sleep for 11 seconds 00000100:00100000:2.0:1787790649.767423:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958272 00000100:00100000:2.0:1787790649.767428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958272 00000100:00100000:2.0:1787790649.767461:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790649.767468:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092c98110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267958272:12345-0@lo:501: 00000100:00100000:2.0:1787790649.767572:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092c98110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267958272:12345-0@lo:501: Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790649.767579:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790649.767646:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267958272:0@lo:501: 00000100:00100000:3.0:1787790649.767675:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267958400:0@lo:503: 00000100:00100000:3.0:1787790649.767730:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.767748:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e6250a7 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.767866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958400 00000100:00100000:0.0:1787790649.767870:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958400 00000100:00100000:0.0:1787790649.767910:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787790649.767917:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088ef69ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267958400:12345-0@lo:503: 00000100:00100000:0.0:1787790649.768081:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088ef69ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267958400:12345-0@lo:503: Request processed in 165us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.768088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790649.768206:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267958400:0@lo:503: 00000100:00100000:3.0:1787790649.771926:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7456:1874634267958528:0@lo:502: 00000100:00100000:3.0:1787790649.772019:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.772061:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cd799cd going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.772210:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958528 00000100:00100000:0.0:1787790649.772218:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958528 00000100:00100000:0.0:1787790649.772266:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787790649.772274:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083d82924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:7456:x1874634267958528:12345-0@lo:502: 00000100:00100000:0.0:1787790649.772404:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083d82924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:7456:x1874634267958528:12345-0@lo:502: Request processed in 130us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.772411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790649.772691:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280c850a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7456:1874634267958528:0@lo:502: 00000020:01000000:3.0:1787790649.772758:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790649.772781:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790649.772784:0:7456:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787790649.772790:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790649.772794:0:7456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:3.0:1787790649.772818:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790649.772831:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000db2800d9) 00000020:00000080:3.0:1787790649.772854:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787790649.772861:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790649.772950:0:7456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787790649.772964:0:7456:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787790649.772971:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d684 00010000:00080000:3.0:1787790649.773000:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e4fd7631@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790649.774608:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:0.0:1787790649.778300:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787790649.778315:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787790649.778352:0:7456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787790649.778375:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d68b 00000100:00080000:0.0:1787790649.778384:0:7456:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790649.778390:0:7456:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000e4fd7631 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790649.778424:0:7456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006a5a8fbd x1874634267958656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790649.778460:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787790649.778522:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790649.778536:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634267958784:0@lo:400: 00000100:00100000:0.0:1787790649.778616:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1787790649.778676:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1787790649.778975:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a5a8fbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267958656:0@lo:38: 00000100:00100000:3.0:1787790649.779040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.779092:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958784 00000100:00100000:3.0:1787790649.779098:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958784 00000100:00100000:3.0:1787790649.779140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790649.779148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c3a5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634267958784:12345-0@lo:400: 00000100:00100000:3.0:1787790649.779199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c3a5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634267958784:12345-0@lo:400: Request processed in 51us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.779206:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790649.779462:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958656 00000100:00100000:0.0:1787790649.779470:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958656 00000100:00100000:0.0:1787790649.779497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790649.779501:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000280c850a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634267958656:12345-0@lo:38: 00010000:02000000:0.0:1787790649.779515:0:6517:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00010000:00080000:2.0:1787790649.783675:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000090169852 x1874634267958784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790649.783739:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634267958784:0@lo:400: 00000100:00080000:3.0:1787790649.784027:0:7459:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000009bb5ca7a x1874634267958912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790649.784037:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000140f029a going to sleep for 0 seconds 00000020:01000000:2.0:1787790649.784216:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790649.784222:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790649.784224:0:7456:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787790649.784227:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790649.784232:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790649.784233:0:7456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790649.784236:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790649.784238:0:7456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787790649.784259:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f3c0c22 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7456:1874634267959040:0@lo:502: 00000100:00100000:2.0:1787790649.784330:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.784371:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000870a0670 going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.784814:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959040 00000100:00100000:3.0:1787790649.784820:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959040 00000100:00100000:3.0:1787790649.784865:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787790649.784879:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1908b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:7456:x1874634267959040:12345-0@lo:502: 00000100:00100000:3.0:1787790649.785005:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1908b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:7456:x1874634267959040:12345-0@lo:502: Request processed in 126us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.785012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787790649.785179:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f3c0c22 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:7456:1874634267959040:0@lo:502: 00000020:01000000:3.0:1787790649.785203:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790649.785208:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790649.785210:0:7456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787790649.785214:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00010000:1.0:1787790649.785478:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1787790649.785732:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000020:01000000:0.0:1787790649.786477:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787790649.786507:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787790649.786516:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.786526:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000a8bf2f8d/0xcf9477fddcf1d66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790649.786537:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787790649.786539:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9170d6383370 from 1 10000000:01000000:0.0:1787790649.786541:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787790649.786569:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.786576:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.786584:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.786601:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267959168:0@lo:101: 00000100:00100000:0.0:1787790649.786650:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.786895:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e96d1a going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.787202:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000280c850a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634267958656:12345-0@lo:38: Request processed in 7699us (8162us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787790649.787211:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787790649.787546:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000e4fd7631 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787790649.787552:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787790649.787556:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a5a8fbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267958656:0@lo:38: 00000100:00100000:3.0:1787790649.789434:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959168 00000100:00100000:3.0:1787790649.789447:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959168 00000100:00100000:3.0:1787790649.789547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787790649.789558:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000014d0adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267959168:12345-0@lo:101: 00010000:00010000:3.0:1787790649.789572:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790649.789589:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a688568/0xcf9477fddcf1d699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d692 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.789614:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a688568/0xcf9477fddcf1d699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.789625:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a688568/0xcf9477fddcf1d699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.789634:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a688568, rc 0) 00000100:00100000:3.0:1787790649.789726:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000014d0adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267959168:12345-0@lo:101: Request processed in 170us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.789733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787790649.789826:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267959168:0@lo:101: 00010000:00010000:0.0:1787790649.789843:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.789852:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.789949:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267959296:0@lo:501: 00000100:00100000:0.0:1787790649.789991:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.790193:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e96d1a going to sleep for 11 seconds 00000100:00100000:2.0:1787790649.790227:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959296 00000100:00100000:2.0:1787790649.790232:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959296 00000100:00100000:2.0:1787790649.790253:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787790649.790258:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006772a1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267959296:12345-0@lo:501: 00000100:00100000:2.0:1787790649.790331:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006772a1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267959296:12345-0@lo:501: Request processed in 73us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790649.790337:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787790649.790417:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267959296:0@lo:501: 10000000:01000000:0.0:1787790649.790447:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787790649.790452:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.790460:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000c5a570c0/0xcf9477fddcf1d692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787790649.792405:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787790649.793195:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787790649.805470:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787790649.805485:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790649.805493:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790649.805495:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787790649.805499:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790649.805506:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790649.805507:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787790649.805510:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787790649.805515:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:1.0:1787790649.805543:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790649.805568:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000050a86651) 00000020:00000080:1.0:1787790649.805591:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:1.0:1787790649.805597:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787790649.805682:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787790649.805689:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787790649.805696:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1d6a7 00010000:00080000:1.0:1787790649.805752:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c2eab094@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790649.811021:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:0.0:1787790649.812358:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787790649.812375:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787790649.812411:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787790649.812431:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d6ae 00000100:00080000:0.0:1787790649.812441:0:7454:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790649.812445:0:7454:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000c2eab094 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790649.812477:0:7454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000090169852 x1874634267959424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790649.812506:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787790649.812582:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790649.812591:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790649.812592:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787790649.812596:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787790649.812599:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787790649.812600:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790649.812602:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790649.812603:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787790649.812605:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790649.812607:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787790649.812609:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790649.812613:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790649.812614:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787790649.812618:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787790649.812650:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787790649.812662:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790649.812665:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790649.812666:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787790649.812668:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790649.812670:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790649.812671:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787790649.812674:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787790649.812675:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787790649.812701:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790649.812730:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790649.812732:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787790649.812734:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1787790649.812875:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634267959424:0@lo:38: 00000100:00100000:3.0:1787790649.812959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.813029:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959424 00000100:00100000:3.0:1787790649.813035:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959424 00000100:00100000:3.0:1787790649.813073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790649.813080:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000029f8008 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634267959424:12345-0@lo:38: 00010000:00080000:3.0:1787790649.813101:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1787790649.813130:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d6b5 00000004:00100000:3.0:1787790649.813143:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787790649.813148:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1787790649.813375:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1787790649.813405:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787790649.813417:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.813428:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000585ea0a8/0xcf9477fddcf1d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790649.813449:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f3e20800 from 1 10000000:01000000:0.0:1787790649.813452:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790649.813476:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.813483:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.813490:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.813504:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cdbe47a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959552:0@lo:101: 00000100:00100000:0.0:1787790649.813535:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.813562:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e96d1a going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.813754:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959552 00000100:00100000:3.0:1787790649.813760:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959552 00000100:00100000:3.0:1787790649.813897:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787790649.813917:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002790149b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:7442:x1874634267959552:12345-0@lo:101: 00010000:00010000:3.0:1787790649.813929:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790649.813940:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d6bc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.813961:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.813972:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.813980:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009521e420, rc 0) 00000100:00100000:3.0:1787790649.814022:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002790149b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:7442:x1874634267959552:12345-0@lo:101: Request processed in 108us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.814029:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787790649.814189:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cdbe47a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959552:0@lo:101: 00010000:00010000:0.0:1787790649.814202:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.814209:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.816368:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cdbe47a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959680:0@lo:256: 00000100:00100000:0.0:1787790649.816441:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.816480:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e96d1a going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.816522:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959680 00000100:00100000:0.0:1787790649.816529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959680 00000100:00100000:0.0:1787790649.817250:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790649.817261:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003142f364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:7442:x1874634267959680:12345-0@lo:256: 20000000:01000000:0.0:1787790649.817286:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787790649.817298:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787790649.817301:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787790649.817389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003142f364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:7442:x1874634267959680:12345-0@lo:256: Request processed in 132us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.817397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787790649.820981:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cdbe47a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959680:0@lo:256: 10000000:01000000:2.0:1787790649.821596:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790649.821623:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.821648:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790649.821656:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3e20800 from 1 10000000:01000000:2.0:1787790649.821658:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790649.821699:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.821726:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.821735:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.821754:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027eac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959808:0@lo:101: 00000100:00100000:2.0:1787790649.822406:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.823107:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e96d1a going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.823218:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959808 00000100:00100000:3.0:1787790649.823235:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959808 00000100:00100000:1.0:1787790649.823289:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787790649.823299:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000996f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:7442:x1874634267959808:12345-0@lo:101: 00010000:00010000:1.0:1787790649.823313:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790649.823328:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d6ca expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.823359:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.823370:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.823379:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005eafbb9e, rc 0) 00000100:00100000:1.0:1787790649.823432:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000996f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:7442:x1874634267959808:12345-0@lo:101: Request processed in 135us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.823439:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790649.823514:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027eac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959808:0@lo:101: 00010000:00010000:2.0:1787790649.823529:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.823537:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.823634:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027eac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959936:0@lo:501: 00000100:00100000:2.0:1787790649.823659:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.823736:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e96d1a going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.823906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267959936 00000100:00100000:0.0:1787790649.823911:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267959936 00000100:00100000:0.0:1787790649.825426:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790649.825436:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fcf022f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:7442:x1874634267959936:12345-0@lo:501: 00000100:00100000:0.0:1787790649.825560:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fcf022f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:7442:x1874634267959936:12345-0@lo:501: Request processed in 125us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.825567:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790649.825607:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027eac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267959936:0@lo:501: 00000100:00100000:0.0:1787790649.825647:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035507cd5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960064:0@lo:503: 00000100:00100000:0.0:1787790649.825688:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.825726:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015bb52e1 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.825742:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960064 00000100:00100000:0.0:1787790649.825746:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960064 00000100:00100000:0.0:1787790649.825761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790649.825765:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021a60935 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:7442:x1874634267960064:12345-0@lo:503: 00000040:00080000:0.0:1787790649.825855:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787790649.825887:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021a60935 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:7442:x1874634267960064:12345-0@lo:503: Request processed in 121us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.825893:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790649.825936:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035507cd5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960064:0@lo:503: 00000040:00080000:0.0:1787790649.826324:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790649.826372:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1787790649.826436:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787790649.827319:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000af36a970 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790649.827391:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000029f8008 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634267959424:12345-0@lo:38: Request processed in 14310us (14432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.827401:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790649.827477:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790649.827486:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787790649.827494:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787790649.827500:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787790649.827503:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000c2eab094 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787790649.827522:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090169852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634267959424:0@lo:38: 00000100:00100000:0.0:1787790649.827642:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790649.827652:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267960192:0@lo:41: 00000100:00100000:0.0:1787790649.827689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.827788:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960192 00000100:00100000:0.0:1787790649.827793:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960192 00000100:00100000:0.0:1787790649.827826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790649.827834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035507cd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874634267960192:12345-0@lo:41: 00000004:00000024:0.0:1787790649.827857:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787790649.827892:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035507cd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874634267960192:12345-0@lo:41: Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.827909:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790649.827937:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267960192:0@lo:41: 00000040:00080000:0.0:1787790649.828978:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787790649.829209:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787790649.829240:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790649.829288:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.829299:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790649.829345:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787790649.829347:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170f3e20800 10000000:01000000:1.0:1787790649.829350:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170f3e20800 10000000:01000000:1.0:1787790649.829353:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790649.829358:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3e20800 from 1 10000000:01000000:1.0:1787790649.829360:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787790649.829389:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.829396:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.829418:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790649.829434:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960320:0@lo:101: 00000100:00100000:1.0:1787790649.829484:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.829550:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a776d65d going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.829600:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960320 00000100:00100000:3.0:1787790649.829606:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960320 00000100:00100000:3.0:1787790649.829671:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787790649.829680:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b10bb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:7442:x1874634267960320:12345-0@lo:101: 00010000:00010000:3.0:1787790649.829692:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790649.830134:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075b1e2c5/0xcf9477fddcf1d6df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d6d8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.830163:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075b1e2c5/0xcf9477fddcf1d6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.830173:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075b1e2c5/0xcf9477fddcf1d6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790649.830181:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075b1e2c5, rc 0) 00000100:00100000:3.0:1787790649.830228:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b10bb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960320:12345-0@lo:101: Request processed in 549us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.830235:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790649.830302:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960320:0@lo:101: 00010000:00010000:1.0:1787790649.830314:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790649.830321:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790649.830403:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960448:0@lo:501: 00000100:00100000:1.0:1787790649.830429:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.830543:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a776d65d going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.830618:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960448 00000100:00100000:0.0:1787790649.830622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960448 00000100:00100000:0.0:1787790649.830645:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790649.830651:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068e26856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960448:12345-0@lo:501: 00000100:00100000:1.0:1787790649.830861:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960448:0@lo:501: 00000100:00100000:1.0:1787790649.830889:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960576:0@lo:503: 00000100:00100000:1.0:1787790649.830939:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.830948:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a776d65d going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.831003:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068e26856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960448:12345-0@lo:501: Request processed in 122us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.831010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790649.831028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960576 00000100:00100000:0.0:1787790649.831032:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960576 00000100:00100000:0.0:1787790649.831056:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787790649.831060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d6be83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960576:12345-0@lo:503: 00000100:00100000:0.0:1787790649.831144:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d6be83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960576:12345-0@lo:503: Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.831150:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787790649.831212:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960576:0@lo:503: 00000040:00080000:1.0:1787790649.831457:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790649.831522:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960704:0@lo:502: 00000100:00100000:1.0:1787790649.831552:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.831575:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000003071b83b going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.831621:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960704 00000100:00100000:0.0:1787790649.831625:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960704 00000100:00100000:0.0:1787790649.831641:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790649.831646:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c163c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960704:12345-0@lo:502: 00000100:00100000:0.0:1787790649.831734:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c163c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960704:12345-0@lo:502: Request processed in 87us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.831740:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787790649.831814:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960704:0@lo:502: 00000040:00080000:1.0:1787790649.832015:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787790649.832039:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787790649.832053:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787790649.832077:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787790649.832091:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787790649.832104:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787790649.832115:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787790649.832127:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787790649.832139:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787790649.832151:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787790649.832165:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787790649.832178:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787790649.832190:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787790649.832203:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787790649.832216:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787790649.832227:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787790649.832239:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787790649.832250:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787790649.832261:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787790649.832288:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787790649.832303:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787790649.832317:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787790649.832331:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787790649.832345:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787790649.832359:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787790649.832372:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787790649.832383:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787790649.832394:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1787790649.832415:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960832:0@lo:502: 00000100:00100000:1.0:1787790649.832454:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.832485:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000003071b83b going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.832604:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960832 00000100:00100000:0.0:1787790649.832609:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960832 00000100:00100000:0.0:1787790649.832631:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790649.832638:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006da1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960832:12345-0@lo:502: 00000100:00100000:0.0:1787790649.832744:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006da1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267960832:12345-0@lo:502: Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.832751:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790649.832946:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267960832:0@lo:502: 00000040:00080000:1.0:1787790649.832989:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787790649.832997:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787790649.833995:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787790649.834012:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000efdd393e) 00000020:00000080:1.0:1787790649.834057:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:1.0:1787790649.834161:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a6057164 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787790649.834165:0:7465:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a6057164 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787790649.834167:0:7465:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a6057164 3 00010000:00080000:1.0:1787790649.834196:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000092001774@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790649.836686:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:1.0:1787790649.838213:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787790649.838255:0:7465:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787790649.838269:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf9477fddcf1d6ed 00000100:00080000:1.0:1787790649.838279:0:7465:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790649.838284:0:7465:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000092001774 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790649.838318:0:7465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e8b5118b x1874634267960960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790649.838353:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634267960960:0@lo:38: 00000100:00100000:1.0:1787790649.838414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.838473:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267960960 00000100:00100000:1.0:1787790649.838479:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267960960 00000100:00100000:1.0:1787790649.838504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790649.838510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003744db50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634267960960:12345-0@lo:38: 00010000:00080000:1.0:1787790649.838531:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1787790649.838565:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf9477fddcf1d6f4 00000004:00100000:1.0:1787790649.838738:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787790649.838769:0:6512:0:(import.c:65:import_set_state_nolock()) 000000007ebd8882 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790649.838816:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003744db50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874634267960960:12345-0@lo:38: Request processed in 304us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.838823:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787790649.838860:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e8b5118b x1874634267960960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790649.838869:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790649.838875:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787790649.838881:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787790649.838885:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790649.838887:0:3637:0:(import.c:65:import_set_state_nolock()) 0000000092001774 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790649.838891:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634267960960:0@lo:38: 00000100:00080000:1.0:1787790649.839246:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787790649.841171:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1787790649.841354:0:7466:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1787790649.841449:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787790649.841476:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790649.841491:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.841503:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000affac8bb/0xcf9477fddcf1d6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787790649.841546:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787790649.841548:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787790649.841549:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790649.841552:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790649.841553:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790649.841554:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790649.841555:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790649.841556:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790649.841557:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790649.841558:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790649.841559:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790649.841561:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1787790649.841563:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790649.841564:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787790649.841564:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790649.841565:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790649.841565:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790649.841566:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790649.841566:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787790649.841567:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790649.841568:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790649.841568:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790649.841569:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790649.841591:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787790649.841607:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e02a138d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267961088:0@lo:253: 00000100:00100000:0.0:1787790649.841673:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.841747:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a36ea25 going to sleep for 11 seconds 00000100:00100000:2.0:1787790649.841877:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961088 00000100:00100000:2.0:1787790649.841884:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961088 00000100:00100000:2.0:1787790649.841932:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790649.841939:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f75fa325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267961088:12345-0@lo:253: 20000000:01000000:2.0:1787790649.841961:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787790649.841973:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787790649.844419:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787790649.844488:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787790649.844532:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787790649.844915:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f75fa325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:7442:x1874634267961088:12345-0@lo:253: Request processed in 2961us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790649.844927:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787790649.845029:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e02a138d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:7442:1874634267961088:0@lo:253: 10000000:01000000:3.0:1787790649.845098:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787790649.845102:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787790649.845104:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787790649.845105:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790649.845112:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790649.845114:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790649.845115:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790649.845117:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787790649.845118:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790649.845120:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790649.845121:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790649.845385:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787790649.845403:0:7442:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787790649.846145:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790649.846151:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790649.846170:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846185:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846192:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846197:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846232:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846253:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 17 pid: 6507 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.846266:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f65525f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267961216:0@lo:104: 00000100:00100000:2.0:1787790649.846312:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790649.846352:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846360:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.846366:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c1aa983 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267961344:0@lo:104: 00000100:00100000:2.0:1787790649.846385:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790649.846398:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b83a3323 going to sleep for 11 seconds 00000100:00100000:2.0:1787790649.846418:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961216 00000100:00100000:2.0:1787790649.846423:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961216 00000100:00100000:2.0:1787790649.846451:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961344 00000100:00100000:2.0:1787790649.846453:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961344 00000100:00100000:2.0:1787790649.846463:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790649.846468:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000340613a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:6528:x1874634267961216:12345-0@lo:104: 00010000:00010000:2.0:1787790649.846478:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846514:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790649.846519:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000340613a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:6528:x1874634267961216:12345-0@lo:104: Request processed in 51us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790649.846525:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790649.846538:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790649.846548:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027eac8f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267961344:12345-0@lo:104: 00010000:00010000:2.0:1787790649.846554:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846581:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790649.846585:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027eac8f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267961344:12345-0@lo:104: Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790649.846591:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787790649.846606:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790649.846610:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846617:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e4204f41 already unused, calling callback (00000000faf0a9d0) 10000000:00010000:2.0:1787790649.846620:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846627:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790649.846634:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790649.846640:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790649.846663:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846670:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790649.846692:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846726:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 00000000e4204f41/0xcf9477fddcf1d6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6c3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.846726:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f3c0c22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267961472:0@lo:103: 00010000:00010000:2.0:1787790649.846737:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790649.846739:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846744:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000122f8210 already unused, calling callback (00000000faf0a9d0) 10000000:00010000:2.0:1787790649.846746:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.846752:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.846755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1787790649.846758:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790649.846763:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787790649.846787:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961472 00000100:00100000:0.0:1787790649.846791:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961472 00010000:00010000:0.0:1787790649.846807:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 18 pid: 6507 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790649.846828:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790649.846834:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000446804da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+18:3639:x1874634267961472:12345-0@lo:103: 00010000:00010000:0.0:1787790649.846843:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790649.846847:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 18 pid: 6507 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.846860:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 18 pid: 6507 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790649.846873:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790649.846908:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000446804da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+18:3639:x1874634267961472:12345-0@lo:103: Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.846914:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790649.846946:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f3c0c22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267961472:0@lo:103: 00010000:00010000:2.0:1787790649.847944:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.847954:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790649.847974:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.847981:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 00000000122f8210/0xcf9477fddcf1d5d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.847997:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790649.848006:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790649.848008:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790649.848014:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790649.848033:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfa46f2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267961600:0@lo:103: 00000100:00100000:2.0:1787790649.848071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790649.848119:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009521e420/0xcf9477fddcf1d6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d6bc expref: 17 pid: 6507 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.848874:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f65525f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267961216:0@lo:104: 00000100:00100000:2.0:1787790649.848892:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c1aa983 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267961344:0@lo:104: 00010000:00010000:2.0:1787790649.848922:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787790649.850933:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:2.0:1787790649.851851:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961600 00000100:00100000:2.0:1787790649.851862:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961600 00010000:00010000:2.0:1787790649.851894:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790649.851938:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790649.851946:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed4be7da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+17:3640:x1874634267961600:12345-0@lo:103: 00010000:00010000:2.0:1787790649.851959:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790649.851964:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.851975:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.851991:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006742a8e9/0xcf9477fddcf1d5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d5d5 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.852021:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.852028:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787790649.852241:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787790649.852499:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787790649.852682:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 20000000:01000000:2.0:1787790649.853014:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006862780s 00010000:00010000:2.0:1787790649.853020:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853027:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853033:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853038:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853102:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d51c0f5 already unused, calling callback (0000000066e79be5) 00010000:00010000:2.0:1787790649.853106:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853113:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853332:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853348:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790649.853429:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed4be7da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+16:3640:x1874634267961600:12345-0@lo:103: Request processed in 1483us (5356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790649.853438:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790649.853517:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfa46f2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267961600:0@lo:103: 00010000:00010000:2.0:1787790649.853545:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853553:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790649.853558:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d51c0f5/0xcf9477fddcf1d6fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787790649.853958:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787790649.854216:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787790649.855249:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787790649.855513:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787790649.855691:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1787790649.855991:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787790649.856278:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1787790649.856458:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787790649.858007:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787790649.858325:0:7471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787790649.858412:0:7471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1874634267961728:0@lo:700: 00000100:00100000:3.0:1787790649.858482:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790649.858522:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961728 00000100:00100000:3.0:1787790649.858529:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961728 00000100:00100000:3.0:1787790649.858566:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790649.858575:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbdd2024 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1874634267961728:12345-0@lo:700: 00000100:00100000:3.0:1787790649.858722:0:7471:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c99e8e9d going to sleep for 11 seconds 00000020:00080000:1.0:1787790649.858785:0:7470:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787790649.858790:0:7470:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787790649.859245:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787790649.859610:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267961856:0@lo:1000: 00000100:00100000:1.0:1787790649.859664:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790649.860025:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961856 00000100:00100000:0.0:1787790649.860031:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961856 00000100:00100000:1.0:1787790649.860239:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000548ccc63 going to sleep for 11 seconds 00000100:00100000:0.0:1787790649.860293:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790649.860302:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c9e7d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267961856:12345-0@lo:1000: 00000100:00100000:0.0:1787790649.860386:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c9e7d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267961856:12345-0@lo:1000: Request processed in 85us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790649.860393:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790649.860457:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267961856:0@lo:1000: 00000040:01000000:1.0:1787790649.860491:0:7472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1787790649.860523:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267961984:0@lo:700: 00000100:00100000:1.0:1787790649.860548:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.860566:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000548ccc63 going to sleep for 11 seconds 00000040:01000000:2.0:1787790649.861041:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787790649.861156:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787790649.861566:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787790649.861574:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787790649.861691:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790649.862644:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787790649.863221:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787790649.863247:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787790649.863386:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787790649.863530:0:7442:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:3.0:1787790649.864219:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267961984 00000100:00100000:3.0:1787790649.864233:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267961984 00100000:10000000:2.0:1787790649.864234:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:3.0:1787790649.864277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790649.864284:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038e1eb3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267961984:12345-0@lo:700: 00000100:00100000:3.0:1787790649.864377:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038e1eb3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267961984:12345-0@lo:700: Request processed in 94us (3829us total) trans 0 rc 0/0 00100000:10000000:2.0:1787790649.864378:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:3.0:1787790649.864385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1787790649.864497:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787790649.864629:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:1.0:1787790649.864664:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267961984:0@lo:700: 00000100:00100000:1.0:1787790649.864756:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1874634267962112:0@lo:900: 00000100:00100000:1.0:1787790649.864790:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.864813:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000548ccc63 going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.864886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267962112 00000100:00100000:3.0:1787790649.864890:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267962112 00000100:00100000:3.0:1787790649.864925:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790649.864931:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000489f986d pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1874634267962112:12345-0@lo:900: 00000100:00100000:3.0:1787790649.865052:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000489f986d pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1874634267962112:12345-0@lo:900: Request processed in 121us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.865059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1787790649.865167:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787790649.865298:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00010000:00080000:1.0:1787790649.865360:0:7472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e8b5118b x1874634267962112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787790665 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790649.865371:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1874634267962112:0@lo:900: 00000100:00100000:1.0:1787790649.865440:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267962240:0@lo:1000: 00000100:00100000:1.0:1787790649.865470:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1787790649.865492:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000100:00100000:1.0:1787790649.865503:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a209806c going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.865555:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267962240 00000100:00100000:3.0:1787790649.865561:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267962240 00000100:00100000:3.0:1787790649.865592:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787790649.865599:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ce8cd5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267962240:12345-0@lo:1000: 00100000:10000000:2.0:1787790649.865633:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:3.0:1787790649.865666:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ce8cd5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267962240:12345-0@lo:1000: Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.865672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790649.865832:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267962240:0@lo:1000: 00000004:00080000:1.0:1787790649.865870:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000548ccc63 with version 0 00000020:00100000:1.0:1787790649.865883:0:7472:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787790649.865888:0:7472:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e8b5118b x1874634267962496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790649.865911:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267962496:0@lo:1000: 00000100:00100000:1.0:1787790649.865940:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1787790649.865961:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:1.0:1787790649.865963:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a209806c going to sleep for 11 seconds 00000100:00100000:3.0:1787790649.866083:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267962496 00000100:00100000:3.0:1787790649.866088:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267962496 00000100:00100000:3.0:1787790649.866105:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790649.866110:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a31deee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267962496:12345-0@lo:1000: 00100000:10000000:2.0:1787790649.866214:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787790649.866338:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787790649.866541:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787790649.866739:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787790649.866988:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787790649.867204:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787790649.867333:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787790649.867618:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 40000000:02000000:3.0:1787790649.868134:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1787790649.868161:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787790649.868287:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787790649.868436:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787790649.868581:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787790649.868732:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787790649.868959:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787790649.869181:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787790649.869308:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787790649.869449:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787790649.869577:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787790649.869865:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787790649.870021:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787790649.870190:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787790649.870354:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787790649.870506:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787790649.870947:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787790649.874973:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787790649.875016:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa8b301c77988 00100000:10000000:2.0:1787790649.875025:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787790649.875672:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787790649.875698:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787790649.875888:0:7442:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787790649.875916:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787790649.876659:0:7442:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790649.877036:0:7442:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1787790649.881055:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbdd2024 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1874634267961728:12345-0@lo:700: Request processed in 22474us (22565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.881080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787790649.881134:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bc13f776 x1874634267961728/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787790665 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790649.881150:0:7471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc13f776 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1874634267961728:0@lo:700: 40000000:02000000:3.0:1787790649.881164:0:7471:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:3.0:1787790649.902468:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1787790649.902597:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a31deee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267962496:12345-0@lo:1000: Request processed in 36483us (36653us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787790649.902608:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:1.0:1787790649.902748:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787790649.902753:0:7472:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787790649.902768:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267962496:0@lo:1000: 00000100:00100000:1.0:1787790649.903169:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267962624:0@lo:1000: 00000100:00100000:1.0:1787790649.903217:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790649.903298:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ff3a2c6 going to sleep for 11 seconds 00000100:00100000:2.0:1787790649.914195:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267962624 00000100:00100000:2.0:1787790649.914210:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267962624 00000100:00100000:3.0:1787790649.916991:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787790649.917006:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089ff7c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267962624:12345-0@lo:1000: 00000100:00100000:3.0:1787790649.917151:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089ff7c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874634267962624:12345-0@lo:1000: Request processed in 149us (13933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790649.917158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790649.917265:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1874634267962624:0@lo:1000: 00000040:00080000:1.0:1787790649.917294:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787790649.917331:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a209806c with version 1 00000040:00080000:1.0:1787790649.919332:0:7472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787790649.919408:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787790649.919500:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f747a444 version 1 rpc_version 1 00000020:00100000:1.0:1787790649.919531:0:7462:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787790649.919539:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e8b5118b x1874634267962880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790649.919557:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1874634267962880:0@lo:1000: 00000100:00100000:1.0:1787790649.919626:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787790649.921753:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790649.925927:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 000000002489fef6 going to sleep for 11 seconds 00000040:00080000:0.0:1787790649.926227:0:7471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787790649.926296:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787790649.926301:0:7471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:2.0:1787790649.926491:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267962880 00000100:00100000:2.0:1787790649.926502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267962880 00000100:00100000:2.0:1787790649.926549:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790649.926557:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3094eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1874634267962880:12345-0@lo:1000: 00000001:00080000:0.0:1787790649.929970:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787790649.930142:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3094eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1874634267962880:12345-0@lo:1000: Request processed in 3582us (10512us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787790649.930154:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:0.0:1787790649.930261:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787790649.930266:0:7462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787790649.930279:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b5118b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1874634267962880:0@lo:1000: 00010000:00010000:3.0:1787790650.187486:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790650.827788:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000140f029a going to sleep for 0 seconds 00010000:00010000:2.0:1787790651.210833:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790651.851263:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000140f029a going to sleep for 0 seconds 00010000:00010000:1.0:1787790652.235444:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790652.874770:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000140f029a going to sleep for 0 seconds 00010000:00010000:2.0:1787790653.259431:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790653.822529:0:7716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787790653.901111:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000140f029a going to sleep for 0 seconds 00010000:00010000:1.0:1787790654.282909:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787790654.616218:0:7768:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790654.616363:0:7768:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787790654.922827:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000140f029a going to sleep for 0 seconds 00010000:00010000:2.0:1787790655.306890:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787790655.309221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787790655.309239:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787790655.309241:0:37:0:(import.c:65:import_set_state_nolock()) 00000000e4fd7631 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790655.309249:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 198 00000100:00080000:0.0:1787790655.309255:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787790655.309261:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000e4fd7631 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790655.309282:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e3b2cacc x1874634267963264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790655.309355:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267963392:0@lo:400: 00000100:00100000:0.0:1787790655.309419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.309474:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790655.309480:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634267963136:0@lo:400: 00000100:00100000:0.0:1787790655.309504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.309531:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3b2cacc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267963264:0@lo:38: 00000100:00100000:0.0:1787790655.309556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.309588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963136 00000100:00100000:0.0:1787790655.309595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963136 00000100:00100000:0.0:1787790655.309633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790655.309640:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000446804da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634267963136:12345-0@lo:400: 00000100:00100000:0.0:1787790655.309681:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000446804da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634267963136:12345-0@lo:400: Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.309688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787790655.309739:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000026d20724 x1874634267963136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790655.309750:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026d20724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634267963136:0@lo:400: 00000100:00100000:2.0:1787790655.309993:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025985ffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267963008:0@lo:400: 00000100:00100000:2.0:1787790655.310027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790655.310062:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790655.310067:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003146928a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267963520:0@lo:400: 00000100:00100000:2.0:1787790655.310092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790655.310133:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963392 00000100:00100000:2.0:1787790655.310136:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963392 00000100:00100000:2.0:1787790655.310157:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963264 00000100:00100000:2.0:1787790655.310161:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963264 00000100:00100000:2.0:1787790655.310170:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790655.310176:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f4de92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267963392:12345-0@lo:400: 00000100:00100000:2.0:1787790655.310212:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f4de92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267963392:12345-0@lo:400: Request processed in 36us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790655.310218:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790655.310229:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790655.310232:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e02a138d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634267963264:12345-0@lo:38: 00010000:00080000:2.0:1787790655.310253:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1787790655.310286:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d702 00000004:00100000:2.0:1787790655.310300:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787790655.310305:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787790655.310386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963520 00000100:00100000:2.0:1787790655.310390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963520 00000100:00100000:2.0:1787790655.310411:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790655.310417:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e11fc2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267963520:12345-0@lo:400: 00000100:00100000:2.0:1787790655.310452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e11fc2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267963520:12345-0@lo:400: Request processed in 35us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790655.310457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787790655.310479:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003146928a x1874634267963520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790655.310488:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003146928a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267963520:0@lo:400: 00000100:00100000:0.0:1787790655.310831:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963008 00000100:00100000:0.0:1787790655.310841:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963008 00000100:00100000:0.0:1787790655.310884:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790655.310890:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2bb838c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:3641:x1874634267963008:12345-0@lo:400: 00000100:00100000:0.0:1787790655.310927:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2bb838c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:3641:x1874634267963008:12345-0@lo:400: Request processed in 37us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.310933:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790655.310965:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267963392:0@lo:400: 00000100:00100000:0.0:1787790655.310988:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025985ffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267963008:0@lo:400: 00000100:00100000:0.0:1787790655.311529:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023732043 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267963648:0@lo:41: 00000100:00100000:0.0:1787790655.311556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790655.312431:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787790655.312440:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787790655.312532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963648 00000100:00100000:1.0:1787790655.312537:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963648 00000100:00100000:1.0:1787790655.312631:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790655.312637:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025985ffa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267963648:12345-0@lo:41: 00000004:00000024:1.0:1787790655.312663:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787790655.313177:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025985ffa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267963648:12345-0@lo:41: Request processed in 538us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790655.313185:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787790655.313246:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023732043 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267963648:0@lo:41: 00000100:00080000:0.0:1787790655.329296:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000d0ffaea2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790655.329396:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e02a138d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634267963264:12345-0@lo:38: Request processed in 19160us (19838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.329407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790655.329500:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790655.329510:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787790655.329525:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787790655.329530:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787790655.329533:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000e4fd7631 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787790655.329589:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000140f029a): req@000000009bb5ca7a x1874634267958912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790655.329613:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3b2cacc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267963264:0@lo:38: 00000100:00100000:3.0:1787790655.329664:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.329699:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267963776:0@lo:41: 00000100:00100000:1.0:1787790655.329742:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267958912 00000100:00100000:1.0:1787790655.329750:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267958912 00000100:00100000:1.0:1787790655.329786:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790655.329793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc13f776 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267958912:12345-0@lo:1000: 00000100:00100000:1.0:1787790655.329866:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc13f776 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267958912:12345-0@lo:1000: Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790655.329873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790655.329955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790655.330056:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963776 00000100:00100000:1.0:1787790655.330059:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963776 00000100:00100000:1.0:1787790655.330120:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790655.330126:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026d20724 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634267963776:12345-0@lo:41: 00000004:00000024:1.0:1787790655.330145:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787790655.330181:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026d20724 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634267963776:12345-0@lo:41: Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790655.330187:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790655.330238:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267958912:0@lo:1000: 00000100:00100000:0.0:1787790655.330260:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267963776:0@lo:41: 00000040:01000000:3.0:1787790655.330272:0:7459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787790655.330303:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267963904:0@lo:1000: 00000100:00100000:3.0:1787790655.330336:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790655.330365:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c47fec1 going to sleep for 11 seconds 00000100:00100000:1.0:1787790655.330367:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267963904 00000100:00100000:1.0:1787790655.330370:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267963904 00000100:00100000:1.0:1787790655.330398:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790655.330638:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef73bebb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267963904:12345-0@lo:1000: 00000100:00100000:1.0:1787790655.330836:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef73bebb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267963904:12345-0@lo:1000: Request processed in 433us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790655.330864:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790655.330908:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267963904:0@lo:1000: 00000100:00100000:0.0:1787790655.330948:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964032:0@lo:700: 00000100:00100000:0.0:1787790655.330974:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.331026:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051c7b23e going to sleep for 11 seconds 00000100:00100000:1.0:1787790655.331068:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267964032 00000100:00100000:1.0:1787790655.331073:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267964032 00000100:00100000:1.0:1787790655.331139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790655.331145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090169852 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267964032:12345-0@lo:700: 00000100:00100000:1.0:1787790655.331184:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090169852 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267964032:12345-0@lo:700: Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790655.331190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790655.331231:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964032:0@lo:700: 00000100:00100000:0.0:1787790655.331334:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964160:0@lo:1000: 00000100:00100000:0.0:1787790655.331364:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.331380:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1d5e9ee going to sleep for 11 seconds 00000100:00100000:0.0:1787790655.331444:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267964160 00000100:00100000:0.0:1787790655.331448:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267964160 00000100:00100000:0.0:1787790655.331470:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790655.331475:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cdbe47a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267964160:12345-0@lo:1000: 00000100:00100000:0.0:1787790655.331524:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cdbe47a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267964160:12345-0@lo:1000: Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790655.331530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790655.331553:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964160:0@lo:1000: 00000004:00080000:0.0:1787790655.331590:0:7459:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000051c7b23e with version 0 00000020:00100000:0.0:1787790655.331603:0:7459:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787790655.331608:0:7459:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c42e13c1 x1874634267964416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790655.331621:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964416:0@lo:1000: 00000100:00100000:0.0:1787790655.331642:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.331656:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cab10614 going to sleep for 11 seconds 00000100:00100000:0.0:1787790655.331666:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267964416 00000100:00100000:0.0:1787790655.331669:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267964416 00000100:00100000:0.0:1787790655.331689:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790655.331694:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a5a8fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7459:x1874634267964416:12345-0@lo:1000: 00000001:00080000:1.0:1787790655.345126:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787790655.345141:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787790655.345312:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a5a8fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7459:x1874634267964416:12345-0@lo:1000: Request processed in 13614us (13666us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787790655.345325:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1787790655.345403:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787790655.345408:0:7459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787790655.345423:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964416:0@lo:1000: 00000100:00100000:1.0:1787790655.345507:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bb638ed pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964544:0@lo:1000: 00000100:00100000:1.0:1787790655.345546:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790655.345575:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054c80dc2 going to sleep for 11 seconds 00000100:00100000:3.0:1787790655.345618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267964544 00000100:00100000:3.0:1787790655.345624:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267964544 00000100:00100000:3.0:1787790655.345668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790655.345676:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000754540a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7459:x1874634267964544:12345-0@lo:1000: 00000100:00100000:3.0:1787790655.345757:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000754540a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7459:x1874634267964544:12345-0@lo:1000: Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790655.345763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787790655.345972:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bb638ed pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7459:1874634267964544:0@lo:1000: 00000040:00080000:1.0:1787790655.345988:0:7459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787790655.346876:0:7459:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000054e9dff3 with version 1 00000040:00080000:1.0:1787790655.349792:0:7459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787790655.349891:0:7459:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 6, retries 0 00000004:00080000:1.0:1787790655.349896:0:7459:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1787790655.351005:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a840ab23 version 1 rpc_version 1 00000020:00100000:0.0:1787790655.351042:0:7457:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787790655.351052:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c42e13c1 x1874634267964800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790655.351074:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7457:1874634267964800:0@lo:1000: 00000100:00100000:0.0:1787790655.351154:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790655.351183:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd5d2cd going to sleep for 11 seconds 00000100:00100000:0.0:1787790655.351201:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267964800 00000100:00100000:0.0:1787790655.351207:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267964800 00000100:00100000:0.0:1787790655.351249:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790655.351257:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3b2cacc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7457:x1874634267964800:12345-0@lo:1000: 00000001:00080000:2.0:1787790655.359621:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787790655.359863:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3b2cacc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7457:x1874634267964800:12345-0@lo:1000: Request processed in 8604us (8706us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787790655.359877:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1787790655.360168:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787790655.360179:0:7457:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787790655.360194:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7457:1874634267964800:0@lo:1000: 00010000:00010000:1.0:1787790656.331568:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787790656.848174:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787790656.848181:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f3e20800 from 4 10000000:01000000:3.0:1787790656.848185:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787790656.848231:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790656.848243:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790656.848253:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790656.848272:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267964928:0@lo:101: 00000100:00100000:3.0:1787790656.848330:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790656.848370:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070412c87 going to sleep for 11 seconds 00000100:00100000:2.0:1787790656.849864:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267964928 00000100:00100000:2.0:1787790656.849876:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267964928 00000100:00100000:2.0:1787790656.849931:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790656.849939:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8b63e36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267964928:12345-0@lo:101: 00010000:00010000:2.0:1787790656.849955:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790656.849971:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3fa8c6b/0xcf9477fddcf1d710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d709 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.850003:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3fa8c6b/0xcf9477fddcf1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.850013:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3fa8c6b/0xcf9477fddcf1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.850024:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3fa8c6b, rc 0) 00000100:00100000:2.0:1787790656.850082:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8b63e36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267964928:12345-0@lo:101: Request processed in 144us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790656.850088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790656.850134:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bb5ca7a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267964928:0@lo:101: 00010000:00010000:2.0:1787790656.850160:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.850167:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790656.850512:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267965056:0@lo:256: 00000100:00100000:2.0:1787790656.850562:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790656.850593:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c89c6a42 going to sleep for 11 seconds 00000100:00100000:2.0:1787790656.850608:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965056 00000100:00100000:2.0:1787790656.850611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965056 00000100:00100000:2.0:1787790656.850633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787790656.850638:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7cace2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267965056:12345-0@lo:256: 20000000:01000000:2.0:1787790656.850651:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787790656.850665:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787790656.850668:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787790656.850752:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7cace2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267965056:12345-0@lo:256: Request processed in 114us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790656.850759:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787790656.851106:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267965056:0@lo:256: 10000000:01000000:2.0:1787790656.852085:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790656.852098:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.852110:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 000000006742a8e9/0xcf9477fddcf1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790656.852121:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787790656.852123:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170c2ab0800 from 4 10000000:01000000:2.0:1787790656.852127:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787790656.852170:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.852178:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790656.852199:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790656.852355:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267965184:0@lo:101: 00000100:00100000:2.0:1787790656.852410:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790656.852448:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c89c6a42 going to sleep for 11 seconds 00000100:00100000:3.0:1787790656.853121:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965184 00000100:00100000:3.0:1787790656.853132:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965184 00000100:00100000:3.0:1787790656.853406:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787790656.853414:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000606a40e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267965184:12345-0@lo:101: 00010000:00010000:3.0:1787790656.853438:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790656.853450:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009521e420/0xcf9477fddcf1d71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d717 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790656.853472:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009521e420/0xcf9477fddcf1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790656.853482:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009521e420/0xcf9477fddcf1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790656.853491:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009521e420, rc 0) 00000100:00100000:3.0:1787790656.854168:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000606a40e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267965184:12345-0@lo:101: Request processed in 753us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790656.854177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787790656.866004:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faf15bf9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267965184:0@lo:101: 00010000:00010000:0.0:1787790656.866036:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790656.866049:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790656.866580:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bb638ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267965312:0@lo:256: 00000100:00100000:1.0:1787790656.866647:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790656.866696:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008e09da7 going to sleep for 11 seconds 00000100:00100000:3.0:1787790656.866800:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965312 00000100:00100000:3.0:1787790656.866807:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965312 00000100:00100000:3.0:1787790656.866877:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787790656.866885:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066646625 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267965312:12345-0@lo:256: 20000000:01000000:3.0:1787790656.866904:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787790656.866919:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787790656.866923:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787790656.867016:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066646625 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267965312:12345-0@lo:256: Request processed in 132us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790656.867024:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787790656.867504:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bb638ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267965312:0@lo:256: 10000000:01000000:1.0:1787790656.867564:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787790656.867572:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790656.867580:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: 00000000d20d6841/0xcf9477fddcf1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1787790657.223100:0:7871:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790657.223307:0:7871:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787790657.357150:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787790658.167498:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffee22bdb0 20000000:00000080:0.0:1787790658.167515:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9170f3daac00 uarg=0000000000000000 20000000:01000000:0.0:1787790658.169448:0:7919:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787790658.169463:0:7919:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787790658.169469:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787790658.169574:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787790658.169587:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787790658.175110:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790658.175504:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787790658.175597:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787790658.175614:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787790658.175627:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787790658.175644:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790658.175662:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790658.175678:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790658.175685:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790658.175908:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790658.175929:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 17 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790658.175942:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003146928a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1874634267965440:0@lo:104: 00000100:00100000:0.0:1787790658.176015:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790658.176066:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790658.176073:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790658.176081:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1874634267965568:0@lo:104: 00000100:00100000:0.0:1787790658.176096:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6f66cb8 going to sleep for 11 seconds 00000100:00100000:2.0:1787790658.176204:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787790658.176222:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790658.176247:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965440 00000100:00100000:2.0:1787790658.176253:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965440 00000100:00100000:2.0:1787790658.176281:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965568 00000100:00100000:2.0:1787790658.176283:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965568 00000100:00100000:2.0:1787790658.176294:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790658.176300:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080ee81c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:7919:x1874634267965440:12345-0@lo:104: 00010000:00010000:2.0:1787790658.176320:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790658.176383:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790658.176388:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080ee81c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:7919:x1874634267965440:12345-0@lo:104: Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790658.176395:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790658.176442:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790658.176448:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd20a7cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:7919:x1874634267965568:12345-0@lo:104: 00010000:00010000:2.0:1787790658.176455:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790658.176484:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790658.176496:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd20a7cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:7919:x1874634267965568:12345-0@lo:104: Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790658.176501:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787790658.179220:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790658.179233:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179265:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e44ee550 already unused, calling callback (00000000faf0a9d0) 10000000:00010000:3.0:1787790658.179268:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179278:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790658.179284:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790658.179289:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790658.179353:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179358:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790658.179379:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179385:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 00000000e44ee550/0xcf9477fddcf1d6ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6d1 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179400:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790658.179403:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179409:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f24b1bce already unused, calling callback (00000000faf0a9d0) 10000000:00010000:3.0:1787790658.179411:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179427:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790658.179432:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790658.179437:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790658.179452:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179458:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790658.179470:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179475:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: 00000000f24b1bce/0xcf9477fddcf1d59d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d5a4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.179489:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790658.179490:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790658.179492:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790658.179511:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023732043 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267965696:0@lo:103: 00000100:00100000:3.0:1787790658.179591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790658.179744:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003146928a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1874634267965440:0@lo:104: 00000100:00100000:3.0:1787790658.179766:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c42e13c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1874634267965568:0@lo:104: 00010000:00010000:3.0:1787790658.179787:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790658.180017:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965696 00000100:00100000:2.0:1787790658.180024:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965696 00010000:00010000:2.0:1787790658.180053:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 18 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790658.180092:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790658.180100:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bb5ca7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+18:3639:x1874634267965696:12345-0@lo:103: 00010000:00010000:2.0:1787790658.180113:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790658.180118:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 18 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790658.180128:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 18 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790658.180144:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005eafbb9e/0xcf9477fddcf1d6d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d6ca expref: 18 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790658.180160:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790658.180199:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bb5ca7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+17:3639:x1874634267965696:12345-0@lo:103: Request processed in 100us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790658.180206:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790658.180236:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023732043 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267965696:0@lo:103: 00000100:00100000:0.0:1787790658.180496:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790658.180510:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267965824:0@lo:103: 00000100:00100000:0.0:1787790658.180555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790658.180642:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790658.180980:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965824 00000100:00100000:3.0:1787790658.180996:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965824 00010000:00010000:3.0:1787790658.181016:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790658.181047:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787790658.181055:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c42e13c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+17:3641:x1874634267965824:12345-0@lo:103: 00010000:00010000:3.0:1787790658.181064:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790658.181067:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181075:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181086:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004bff0330/0xcf9477fddcf1d5a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d59d expref: 17 pid: 6506 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181098:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181106:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181120:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181126:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181132:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181138:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181149:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005500cfb8 already unused, calling callback (0000000066e79be5) 00010000:00010000:3.0:1787790658.181153:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181159:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181173:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181182:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790658.181214:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c42e13c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+16:3641:x1874634267965824:12345-0@lo:103: Request processed in 161us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790658.181221:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787790658.181246:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181254:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790658.181259:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005500cfb8/0xcf9477fddcf1d725 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790658.182482:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267965824:0@lo:103: 00010000:00010000:2.0:1787790658.381451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790659.403085:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790660.426912:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790660.427910:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b65e138c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267965952:0@lo:41: 00000100:00100000:3.0:1787790660.430445:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267966080:0@lo:41: 00000100:00100000:3.0:1787790660.430562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790660.430610:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfe192ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267966592:0@lo:400: 00000100:00100000:3.0:1787790660.430630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790660.430662:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790660.430668:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023732043 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267966208:0@lo:400: 00000100:00100000:3.0:1787790660.430694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790660.430732:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2e4b139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267966720:0@lo:400: 00000100:00100000:3.0:1787790660.430755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790660.430782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966080 00000100:00100000:3.0:1787790660.430788:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966080 00000100:00100000:3.0:1787790660.430844:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966592 00000100:00100000:3.0:1787790660.430848:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966592 00000100:00100000:3.0:1787790660.430863:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790660.430869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e75aca10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874634267966080:12345-0@lo:41: 00000004:00000024:3.0:1787790660.430901:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787790660.430943:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e75aca10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874634267966080:12345-0@lo:41: Request processed in 74us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790660.431018:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790660.431443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787790660.431452:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e1cf9a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267966592:12345-0@lo:400: 00000100:00100000:3.0:1787790660.431487:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e1cf9a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267966592:12345-0@lo:400: Request processed in 39us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790660.431494:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787790660.431514:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966208 00000100:00100000:3.0:1787790660.431517:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966208 00000100:00100000:3.0:1787790660.431546:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787790660.431552:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007944b1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:3638:x1874634267966208:12345-0@lo:400: 00000100:00100000:3.0:1787790660.431580:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007944b1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:3638:x1874634267966208:12345-0@lo:400: Request processed in 29us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790660.431586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787790660.431623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966720 00000100:00100000:3.0:1787790660.431627:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966720 00000100:00100000:3.0:1787790660.431655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790660.431661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9bdb318 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267966720:12345-0@lo:400: 00000100:00100000:3.0:1787790660.431689:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9bdb318 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267966720:12345-0@lo:400: Request processed in 28us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790660.431695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790660.431759:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023732043 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267966208:0@lo:400: 00010000:00080000:3.0:1787790660.431774:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a2e4b139 x1874634267966720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790660.431784:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2e4b139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267966720:0@lo:400: 00000100:00100000:3.0:1787790660.431798:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8fe590d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267966080:0@lo:41: 00000100:00100000:3.0:1787790660.431817:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfe192ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267966592:0@lo:400: 00000100:00100000:0.0:1787790660.432022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790660.432063:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e210e887 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267966464:0@lo:400: 00000100:00100000:0.0:1787790660.432086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790660.432096:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790660.432101:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e47bd2cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267966336:0@lo:400: 00000100:00100000:0.0:1787790660.432142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790660.432171:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267965952 00000100:00100000:0.0:1787790660.432175:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267965952 00000100:00100000:0.0:1787790660.432192:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966464 00000100:00100000:0.0:1787790660.432194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966464 00000100:00100000:0.0:1787790660.432204:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790660.432210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b2fcc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634267965952:12345-0@lo:41: 00000004:00000024:0.0:1787790660.432234:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787790660.432269:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b2fcc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634267965952:12345-0@lo:41: Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790660.432275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790660.432286:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790660.432291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001118e5a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267966464:12345-0@lo:400: 00000100:00100000:0.0:1787790660.432314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001118e5a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267966464:12345-0@lo:400: Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790660.432319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790660.432333:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966336 00000100:00100000:0.0:1787790660.432336:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966336 00000100:00100000:0.0:1787790660.432355:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790660.432360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003146928a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267966336:12345-0@lo:400: 00000100:00100000:0.0:1787790660.432386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003146928a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267966336:12345-0@lo:400: Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790660.432403:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787790660.432427:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e47bd2cc x1874634267966336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790660.432437:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e47bd2cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267966336:0@lo:400: 00000100:00100000:0.0:1787790660.432447:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e210e887 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267966464:0@lo:400: 00000100:00100000:0.0:1787790660.432456:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b65e138c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267965952:0@lo:41: 00010000:00010000:3.0:1787790661.451468:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790662.475024:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787790662.987892:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787790662.987899:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3e20800 from 1 10000000:01000000:1.0:1787790662.987903:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790662.987944:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d72c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790662.987956:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d72c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790662.987967:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d72c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790662.987990:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c21ae7f6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267966848:0@lo:101: 00000100:00100000:1.0:1787790662.988052:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790662.988227:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000978db7 going to sleep for 11 seconds 00000100:00100000:0.0:1787790662.988396:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966848 00000100:00100000:0.0:1787790662.988405:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966848 00000100:00100000:0.0:1787790662.988620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790662.988630:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bf90c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267966848:12345-0@lo:101: 00010000:00010000:0.0:1787790662.988646:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790662.988662:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d733 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d72c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790662.988684:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790662.988694:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4204f41/0xcf9477fddcf1d733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790662.988722:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4204f41, rc 0) 00000100:00100000:0.0:1787790662.988771:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bf90c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267966848:12345-0@lo:101: Request processed in 143us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790662.988777:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787790662.988796:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c21ae7f6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267966848:0@lo:101: 00010000:00010000:3.0:1787790662.988810:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d72c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.988819:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: 0000000036cac710/0xcf9477fddcf1d72c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.989176:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7e81b99 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267966976:0@lo:501: 00000100:00100000:3.0:1787790662.989206:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.991254:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097506259 going to sleep for 11 seconds 00000100:00100000:2.0:1787790662.991297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267966976 00000100:00100000:2.0:1787790662.991333:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267966976 00000100:00100000:2.0:1787790662.991384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790662.991392:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bb10021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267966976:12345-0@lo:501: 00000100:00100000:2.0:1787790662.991597:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bb10021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267966976:12345-0@lo:501: Request processed in 205us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.991606:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787790662.991658:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7e81b99 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267966976:0@lo:501: 00000100:00100000:2.0:1787790662.991728:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e960367 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967104:0@lo:503: 00000100:00100000:2.0:1787790662.991796:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790662.991818:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b2d51ec going to sleep for 11 seconds 00000100:00100000:2.0:1787790662.991829:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967104 00000100:00100000:2.0:1787790662.991831:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967104 00000100:00100000:2.0:1787790662.991848:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787790662.991852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff616672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267967104:12345-0@lo:503: 00000100:00100000:2.0:1787790662.991956:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff616672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267967104:12345-0@lo:503: Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.991963:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787790662.991996:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e960367 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967104:0@lo:503: 00000100:00100000:3.0:1787790662.994228:0:8184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d573f31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8184:1874634267967232:0@lo:502: 00000100:00100000:3.0:1787790662.994316:0:8184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.994376:0:8184:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093bc2282 going to sleep for 11 seconds 00000100:00100000:2.0:1787790662.994408:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967232 00000100:00100000:2.0:1787790662.994414:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967232 00000100:00100000:2.0:1787790662.994548:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787790662.994556:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c40f3b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:8184:x1874634267967232:12345-0@lo:502: 00000100:00100000:2.0:1787790662.994671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c40f3b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:8184:x1874634267967232:12345-0@lo:502: Request processed in 115us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.994679:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790662.994800:0:8184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d573f31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8184:1874634267967232:0@lo:502: 00000020:01000000:0.0:1787790662.994829:0:8184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790662.994843:0:8184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790662.994845:0:8184:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787790662.994853:0:8184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f3e20800 00000020:00000080:0.0:1787790662.994855:0:8184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790662.994893:0:8184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8184:1874634267967360:0@lo:502: 00000100:00100000:0.0:1787790662.994941:0:8184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.995139:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967360 00000100:00100000:3.0:1787790662.995144:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967360 00000100:00100000:3.0:1787790662.995162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787790662.995167:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:8184:x1874634267967360:12345-0@lo:502: 00000100:00100000:3.0:1787790662.995226:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:8184:x1874634267967360:12345-0@lo:502: Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790662.995233:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790662.995339:0:8184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790662.995353:0:8184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8184:1874634267967360:0@lo:502: 00000020:01000000:0.0:1787790662.995370:0:8184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790662.995374:0:8184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790662.995376:0:8184:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787790662.995380:0:8184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787790662.995603:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787790662.995629:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790662.995638:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.995649:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790662.995659:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790662.995661:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c2ab0800 from 1 10000000:01000000:2.0:1787790662.995664:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790662.995685:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.995693:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790662.996171:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.996275:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967488:0@lo:101: 00000100:00100000:3.0:1787790662.996316:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.996378:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790662.996413:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967488 00000100:00100000:0.0:1787790662.996418:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967488 00000100:00100000:0.0:1787790662.996534:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790662.996542:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267967488:12345-0@lo:101: 00010000:00010000:0.0:1787790662.996553:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790662.996567:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d73a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790662.996594:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790662.996606:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790662.996614:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030a00, rc 0) 00000100:00100000:0.0:1787790662.996651:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267967488:12345-0@lo:101: Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790662.996657:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790662.996937:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967488:0@lo:101: 00010000:00010000:3.0:1787790662.996951:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790662.996960:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790662.997024:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967616:0@lo:501: 00000100:00100000:3.0:1787790662.997049:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.997073:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790662.997085:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967616 00000100:00100000:0.0:1787790662.997089:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967616 00000100:00100000:0.0:1787790662.997121:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787790662.997129:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267967616:12345-0@lo:501: 00000100:00100000:0.0:1787790662.997245:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267967616:12345-0@lo:501: Request processed in 117us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790662.997252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787790662.997291:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967616:0@lo:501: 00000100:00100000:3.0:1787790662.997317:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967744:0@lo:503: 00000100:00100000:3.0:1787790662.997347:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790662.997362:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790662.997377:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967744 00000100:00100000:2.0:1787790662.997381:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967744 00000100:00100000:2.0:1787790662.997413:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787790662.997419:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267967744:12345-0@lo:503: 00000100:00100000:2.0:1787790662.997577:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267967744:12345-0@lo:503: Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790662.997583:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787790662.997867:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267967744:0@lo:503: 00000100:00100000:1.0:1787790663.000420:0:8185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8185:1874634267967872:0@lo:502: 00000100:00100000:1.0:1787790663.000522:0:8185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790663.000564:0:8185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbedf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790663.000566:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267967872 00000100:00100000:0.0:1787790663.000573:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267967872 00000100:00100000:0.0:1787790663.000631:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787790663.000641:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:8185:x1874634267967872:12345-0@lo:502: 00000100:00100000:1.0:1787790663.000836:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:8185:x1874634267967872:12345-0@lo:502: Request processed in 195us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790663.000845:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787790663.000867:0:8185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8185:1874634267967872:0@lo:502: 00000020:01000000:0.0:1787790663.000904:0:8185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790663.000917:0:8185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790663.000919:0:8185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787790663.000929:0:8185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170c2ab0800 00000020:00000080:0.0:1787790663.000932:0:8185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790663.000959:0:8185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8185:1874634267968000:0@lo:502: 00000100:00100000:0.0:1787790663.000995:0:8185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790663.001023:0:8185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2af9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790663.001126:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968000 00000100:00100000:2.0:1787790663.001130:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968000 00000100:00100000:2.0:1787790663.001161:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790663.001174:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:8185:x1874634267968000:12345-0@lo:502: 00000100:00100000:2.0:1787790663.001277:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:8185:x1874634267968000:12345-0@lo:502: Request processed in 102us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790663.001283:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787790663.001337:0:8185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8185:1874634267968000:0@lo:502: 00000020:01000000:0.0:1787790663.001356:0:8185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790663.001360:0:8185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790663.001362:0:8185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787790663.001366:0:8185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787790663.001613:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787790663.001641:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790663.001653:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790663.001666:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790663.499162:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790664.525141:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790665.546957:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790665.546988:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267968128:0@lo:41: 00000100:00100000:3.0:1787790665.547109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790665.547174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968128 00000100:00100000:3.0:1787790665.547182:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968128 00000100:00100000:3.0:1787790665.547227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790665.547236:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267968128:12345-0@lo:41: 00000004:00000024:3.0:1787790665.547265:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787790665.547305:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267968128:12345-0@lo:41: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790665.547312:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790665.547350:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267968128:0@lo:41: 00000100:00100000:3.0:1787790665.549244:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267968256:0@lo:41: 00000100:00100000:3.0:1787790665.549311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790665.549377:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968256 00000100:00100000:3.0:1787790665.549385:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968256 00000100:00100000:3.0:1787790665.549621:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790665.549633:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267968256:12345-0@lo:41: 00000004:00000024:3.0:1787790665.549664:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787790665.549734:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267968256:12345-0@lo:41: Request processed in 105us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790665.549741:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790665.549801:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267968256:0@lo:41: 00000100:00100000:1.0:1787790665.550396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267968384:0@lo:400: 00000100:00100000:1.0:1787790665.550440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790665.550473:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790665.550479:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634267968512:0@lo:400: 00000100:00100000:1.0:1787790665.550549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790665.550582:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968384 00000100:00100000:1.0:1787790665.550586:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968384 00000100:00100000:1.0:1787790665.550620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787790665.550628:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:3638:x1874634267968384:12345-0@lo:400: 00000100:00100000:1.0:1787790665.550664:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:3638:x1874634267968384:12345-0@lo:400: Request processed in 37us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790665.550670:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787790665.550694:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968512 00000100:00100000:1.0:1787790665.550698:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968512 00000100:00100000:1.0:1787790665.550750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790665.550767:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634267968512:12345-0@lo:400: 00000100:00100000:1.0:1787790665.550799:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634267968512:12345-0@lo:400: Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790665.550805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787790665.550853:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbe65a40 x1874634267968512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790665.550865:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634267968512:0@lo:400: 00000100:00100000:1.0:1787790665.550887:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267968384:0@lo:400: 00000100:00100000:0.0:1787790665.551265:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790665.551276:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267968640:0@lo:400: 00000100:00100000:0.0:1787790665.551318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790665.551525:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968640 00000100:00100000:1.0:1787790665.551531:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968640 00000100:00100000:1.0:1787790665.551567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790665.551574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267968640:12345-0@lo:400: 00000100:00100000:1.0:1787790665.551612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267968640:12345-0@lo:400: Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790665.551618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787790665.551741:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbe65680 x1874634267968640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790665.551751:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267968640:0@lo:400: 00010000:00010000:0.0:1787790665.555481:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787790666.427458:0:8419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790666.427462:0:8419:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787790666.427464:0:8419:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787790666.427607:0:8419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170f3c78800 00000020:01000004:2.0:1787790666.427622:0:8419:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787790666.427633:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787790666.427646:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9170facf3370) 00000020:00000080:2.0:1787790666.427660:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787790666.454269:0:8419:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787790666.454461:0:8419:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787790666.471357:0:8419:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787790666.471562:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787790666.471573:0:8419:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787790666.471583:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf9477fddcf1d74f 00000020:01000004:0.0:1787790666.471591:0:8419:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787790666.471609:0:8419:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787790666.471612:0:8419:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787790666.471618:0:8419:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787790666.471623:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787790666.471642:0:8419:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9170fc1319b8) 00000020:00000080:0.0:1787790666.471653:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787790666.474743:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790666.474967:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787790666.474974:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787790666.478148:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787790666.478162:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787790666.478499:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787790666.478506:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787790666.484044:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790666.484354:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787790666.484360:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787790666.490904:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787790666.490922:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787790666.511283:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790666.511501:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787790666.511507:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787790666.513224:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787790666.513240:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787790666.514846:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787790666.514859:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787790666.517310:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790666.517508:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787790666.517514:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787790666.518243:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787790666.518251:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787790666.556645:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790666.557527:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787790666.557535:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787790666.559584:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787790666.559602:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787790666.560660:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787790666.560687:0:8419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787790666.560693:0:8419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:2.0:1787790666.570823:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787790666.582645:0:8419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787790666.582682:0:8419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787790666.582687:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787790666.582734:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790666.582736:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790666.582737:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790666.582739:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790666.582740:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790666.582741:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790666.582743:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790666.582744:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790666.583546:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790666.583549:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790666.583553:0:8419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787790666.583556:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790666.583558:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790666.583559:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790666.583560:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790666.583562:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790666.583563:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790666.583564:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790666.583566:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790666.583567:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790666.583568:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790666.583569:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787790666.583916:0:8419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787790666.583943:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267968768:0@lo:253: 00000100:00100000:2.0:1787790666.584020:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.584315:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790666.584614:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968768 00000100:00100000:1.0:1787790666.584623:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968768 00000100:00100000:1.0:1787790666.584824:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787790666.584834:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:8419:x1874634267968768:12345-0@lo:253: 20000000:01000000:1.0:1787790666.584865:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787790666.584870:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787790666.584875:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787790666.584879:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787790666.585423:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790666.585594:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787790666.585610:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787790666.585636:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787790666.585644:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787790666.585658:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787790666.585674:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787790666.585811:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787790666.585894:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.122@tcp 20000000:01000000:1.0:1787790666.585896:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790666.585916:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787790666.585924:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790666.585940:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787790666.585946:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790666.585959:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787790666.585966:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787790666.585979:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787790666.585994:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787790666.586287:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1787790666.586303:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.122@tcp 20000000:01000000:1.0:1787790666.586305:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790666.586323:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1787790666.586329:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790666.586341:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1787790666.586346:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790666.586359:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1787790666.586365:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787790666.586379:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1787790666.586395:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1787790666.586777:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1787790666.586788:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.122@tcp 20000000:01000000:1.0:1787790666.586790:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790666.586805:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1787790666.586811:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787790666.587007:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1787790666.587015:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790666.587026:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1787790666.587031:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787790666.587041:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1787790666.587057:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1787790666.587194:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787790666.587198:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787790666.587202:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787790666.587488:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787790666.587491:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787790666.588027:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787790666.588694:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787790666.589043:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787790666.589321:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787790666.589340:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787790666.589343:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790666.589967:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790666.590000:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790666.590010:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787790666.590269:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787790666.590282:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787790666.590290:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787790666.590295:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787790666.590296:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790666.590525:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790666.590539:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790666.590547:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787790666.590622:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1787790666.590640:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1787790666.590653:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1787790666.590662:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787790666.590664:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790666.591169:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790666.591193:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790666.591204:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787790666.591698:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787790666.591794:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787790666.591810:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1787790666.591824:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787790666.591844:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591873:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591879:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591884:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591887:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591891:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591951:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591982:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.591994:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 18 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.592004:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267968896:0@lo:104: 00000100:00100000:1.0:1787790666.592052:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.592099:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267968896 00000100:00100000:0.0:1787790666.592107:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267968896 00010000:00010000:1.0:1787790666.592287:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.592296:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 18 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.592310:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969024:0@lo:104: 00000100:00100000:1.0:1787790666.592333:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790666.592407:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.592416:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 18 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.592423:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe66940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969152:0@lo:104: 00000100:00100000:1.0:1787790666.592457:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790666.592610:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.592618:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.592630:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969280:0@lo:104: 00000100:00100000:1.0:1787790666.592648:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.592667:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969024 00000100:00100000:0.0:1787790666.592667:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969152 00000100:00100000:2.0:1787790666.592671:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969024 00000100:00100000:0.0:1787790666.592671:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969152 00000100:00100000:0.0:1787790666.592691:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790666.592700:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+5:6507:x1874634267968896:12345-0@lo:104: 00010000:00010000:0.0:1787790666.592741:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.592801:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790666.592807:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+5:6507:x1874634267968896:12345-0@lo:104: Request processed in 108us (753us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790666.592810:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.592817:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 18 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.592824:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790666.592826:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969408:0@lo:104: 00000100:00100000:0.0:1787790666.592838:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969280 00000100:00100000:0.0:1787790666.592841:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969280 00000100:00100000:1.0:1787790666.592846:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790666.592899:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787790666.592901:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a94cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787790666.592905:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.592912:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e0000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790666.592915:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.592920:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267968896:0@lo:104: 00010000:00010000:3.0:1787790666.592934:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.592941:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790666.592946:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790666.592987:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.592995:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790666.593015:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593022:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e0000/0xcf9477fddcf1d6d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d6df expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593034:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.593035:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.593037:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790666.593047:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267969536:0@lo:103: 00000100:00100000:2.0:1787790666.593062:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969408 00000100:00100000:2.0:1787790666.593067:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969408 00000100:00100000:3.0:1787790666.593082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.593085:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790666.593130:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969536 00000100:00100000:1.0:1787790666.593134:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969536 00010000:00010000:1.0:1787790666.593151:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.593174:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790666.593181:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+19:3641:x1874634267969536:12345-0@lo:103: 00010000:00010000:1.0:1787790666.593190:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790666.593195:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.593205:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.593218:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102178a00/0xcf9477fddcf1d6df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d6d8 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.593231:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790666.593258:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+18:3641:x1874634267969536:12345-0@lo:103: Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.593264:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790666.593354:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+6:6507:x1874634267969024:12345-0@lo:104: 00010000:00010000:2.0:1787790666.593364:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.593418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267969536:0@lo:103: 00010000:00010000:2.0:1787790666.593542:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790666.593548:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+6:6507:x1874634267969024:12345-0@lo:104: Request processed in 458us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.593555:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787790666.593562:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790666.593567:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790666.593569:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787790666.593574:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030000 already unused, calling callback (ffffffffc11c1c20) 00000100:00100000:2.0:1787790666.593575:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:6507:x1874634267969152:12345-0@lo:104: 00010000:00010000:2.0:1787790666.593582:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.593583:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593591:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.593598:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790666.593603:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790666.593622:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790666.593627:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:6507:x1874634267969152:12345-0@lo:104: Request processed in 53us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.593633:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790666.593647:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790666.593653:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6507:x1874634267969280:12345-0@lo:104: 00010000:00010000:2.0:1787790666.593659:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593661:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593667:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790666.593682:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.593685:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790666.593689:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6507:x1874634267969280:12345-0@lo:104: Request processed in 37us (1040us total) trans 0 rc 0/0 00010000:00010000:3.0:1787790666.593690:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030000/0xcf9477fddcf1d692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d699 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790666.593695:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787790666.593700:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790666.593721:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790666.593725:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787790666.593728:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165ec00 already unused, calling callback (ffffffffc11c1c20) 00000100:00100000:2.0:1787790666.593731:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:6507:x1874634267969408:12345-0@lo:104: 10000000:00010000:3.0:1787790666.593732:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593739:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.593739:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.593768:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790666.593774:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790666.593775:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790666.593779:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:6507:x1874634267969408:12345-0@lo:104: Request processed in 49us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.593789:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787790666.593894:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593901:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790666.593907:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593912:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1d66f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d676 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593922:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790666.593925:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593930:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165e800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790666.593933:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593939:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.593946:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790666.593951:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790666.593981:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.593988:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787790666.593988:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969024:0@lo:104: 00000100:00100000:1.0:1787790666.594001:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe66940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969152:0@lo:104: 00000100:00100000:1.0:1787790666.594009:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969280:0@lo:104: 00010000:00010000:3.0:1787790666.594010:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.594015:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874634267969408:0@lo:104: 00010000:00010000:3.0:1787790666.594017:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c165e800/0xcf9477fddcf1d661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d668 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594025:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790666.594029:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594034:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790666.594037:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.594038:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594044:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.594051:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790666.594055:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787790666.594103:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267969920:0@lo:103: 00000100:00100000:2.0:1787790666.594131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.594267:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969920 00010000:00010000:3.0:1787790666.594273:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594280:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787790666.594325:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787790666.594345:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594362:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d629 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594376:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.594378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.594379:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790666.594393:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267969664:0@lo:103: 00000100:00100000:3.0:1787790666.594417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.594444:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790666.594450:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267969792:0@lo:103: 00000100:00100000:3.0:1787790666.594470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.594495:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969664 00000100:00100000:3.0:1787790666.594499:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969664 00010000:00010000:3.0:1787790666.594516:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 18 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.594530:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267969792 00000100:00100000:3.0:1787790666.594533:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969792 00010000:00010000:3.0:1787790666.594543:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 19 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.594554:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790666.594560:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+19:3638:x1874634267969664:12345-0@lo:103: 00010000:00010000:3.0:1787790666.594568:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790666.594572:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594582:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.594584:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787790666.594592:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787790666.594599:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102178600/0xcf9477fddcf1d699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d692 expref: 19 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594610:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790666.594621:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267969920 00010000:00010000:1.0:1787790666.594637:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 19 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.594645:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+19:3638:x1874634267969664:12345-0@lo:103: Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.594650:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790666.594650:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787790666.594657:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790666.594660:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787790666.594662:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+18:3638:x1874634267969792:12345-0@lo:103: 00000100:00100000:3.0:1787790666.594665:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790666.594669:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+18:3640:x1874634267969920:12345-0@lo:103: 00010000:00010000:1.0:1787790666.594669:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790666.594673:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 18 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594675:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790666.594678:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.594681:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 18 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594696:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.594735:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102179a00/0xcf9477fddcf1d668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d661 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.594740:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267969664:0@lo:103: 00010000:00010000:3.0:1787790666.594745:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790666.594805:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031e00/0xcf9477fddcf1d676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d66f expref: 17 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.594817:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790666.594860:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267970048:0@lo:103: 00000100:00100000:1.0:1787790666.594887:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+16:3638:x1874634267969792:12345-0@lo:103: Request processed in 224us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.594890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.594903:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790666.594913:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787790666.594918:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970048 00000100:00100000:1.0:1787790666.594921:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970048 00010000:00010000:1.0:1787790666.594931:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 16 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.594942:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787790666.594954:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790666.594960:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4789c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+16:3640:x1874634267970048:12345-0@lo:103: 00010000:00010000:1.0:1787790666.594967:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790666.594970:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 16 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.594979:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 16 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.594984:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+16:3640:x1874634267969920:12345-0@lo:103: Request processed in 314us (853us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790666.594989:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e0400/0xcf9477fddcf1d629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d622 expref: 16 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.594990:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787790666.594999:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595007:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595019:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595026:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.595027:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790666.595033:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595039:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595044:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790666.595048:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595060:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595073:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595082:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790666.595111:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4789c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+14:3640:x1874634267970048:12345-0@lo:103: Request processed in 151us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.595116:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787790666.595154:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595161:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.595168:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1000/0xcf9477fddcf1d75d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787790666.595179:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787790666.595284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267969920:0@lo:103: 00000100:00100000:2.0:1787790666.595296:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267970048:0@lo:103: 00000100:00100000:0.0:1787790666.596842:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267969792:0@lo:103: 00000100:00100000:2.0:1787790666.597000:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+13:8419:x1874634267968768:12345-0@lo:253: Request processed in 12166us (12979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.597009:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787790666.597018:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267968768:0@lo:253: 10000000:01000000:1.0:1787790666.597029:0:8419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787790666.597031:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790666.597033:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787790666.597034:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790666.597036:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787790666.597037:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790666.597038:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790666.597039:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790666.597041:0:8419:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787790666.597043:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790666.597051:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790666.597069:0:8419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170f3c78800 from lustre-OST0000 10000000:01000000:1.0:1787790666.597211:0:8419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787790666.597215:0:8419:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787790666.597222:0:8419:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9170d6383370 local copy 10000000:01000000:1.0:1787790666.597226:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787790666.597257:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.597266:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.597275:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.597290:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970176:0@lo:101: 00000100:00100000:1.0:1787790666.597318:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.597350:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a94180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.597355:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970176 00000100:00100000:2.0:1787790666.597360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970176 00000100:00100000:2.0:1787790666.597433:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787790666.597441:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+13:8419:x1874634267970176:12345-0@lo:101: 00010000:00010000:2.0:1787790666.597452:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790666.597464:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1d76b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d764 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.597483:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1d76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d764 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.597492:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1d76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d764 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.597500:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39c00, rc 0) 00000100:00100000:2.0:1787790666.597534:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970176:12345-0@lo:101: Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.597541:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787790666.597560:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970176:0@lo:101: 00010000:00010000:1.0:1787790666.597571:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.597581:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.598620:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970304:0@lo:501: 00000100:00100000:1.0:1787790666.598661:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.598696:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a94180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.598745:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970304 00000100:00100000:2.0:1787790666.598759:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970304 00000100:00100000:2.0:1787790666.598791:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787790666.598798:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970304:12345-0@lo:501: 00000100:00100000:2.0:1787790666.598979:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970304:12345-0@lo:501: Request processed in 180us (317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790666.598986:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787790666.599455:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970304:0@lo:501: 10000000:01000000:1.0:1787790666.599467:0:8419:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787790666.599537:0:8419:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787790666.599543:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.599550:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.599554:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.599569:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790666.599593:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787790666.599596:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170f3c78800 00010000:00010000:3.0:1787790666.599600:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790666.599600:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787790666.599605:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787790666.599607:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790666.599612:0:8419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787790666.599614:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790666.599618:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e0200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790666.599621:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.599628:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.599635:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.599636:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790666.599642:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790666.599644:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.599651:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.599659:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.599663:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970432:0@lo:101: 00010000:00010000:3.0:1787790666.599665:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787790666.599693:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790666.599699:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.599727:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e0200/0xcf9477fddcf1d764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d76b expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.599730:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a949c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787790666.599742:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.599743:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.599745:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790666.599790:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267970560:0@lo:103: 00000100:00100000:0.0:1787790666.599821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.599879:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970432 00000100:00100000:2.0:1787790666.599884:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970432 00000100:00100000:2.0:1787790666.599920:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787790666.599927:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970432:12345-0@lo:101: 00010000:00010000:2.0:1787790666.599936:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790666.599947:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d772 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.599967:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.599977:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.599985:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39600, rc 0) 00000100:00100000:2.0:1787790666.600022:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267970432:12345-0@lo:101: Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.600028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790666.600093:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970560 00000100:00100000:3.0:1787790666.600097:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970560 00000100:00100000:3.0:1787790666.600141:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790666.600149:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+15:3638:x1874634267970560:12345-0@lo:103: 00010000:00010000:3.0:1787790666.600158:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790666.600174:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1d76b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d764 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.600182:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790666.600227:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+14:3638:x1874634267970560:12345-0@lo:103: Request processed in 79us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.600234:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790666.600280:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267970560:0@lo:103: 00000100:00100000:1.0:1787790666.600550:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970432:0@lo:101: 00010000:00010000:1.0:1787790666.600564:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.600570:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.600621:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970688:0@lo:501: 00000100:00100000:1.0:1787790666.600640:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.600656:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a949c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.600674:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970688 00000100:00100000:2.0:1787790666.600678:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970688 00000100:00100000:0.0:1787790666.600742:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787790666.600762:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970688:12345-0@lo:501: 00000100:00100000:0.0:1787790666.600865:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970688:12345-0@lo:501: Request processed in 115us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790666.600872:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787790666.600993:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970688:0@lo:501: 00000100:00100000:1.0:1787790666.601023:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970816:0@lo:503: 00000100:00100000:1.0:1787790666.601053:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.601081:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a949c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.601200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970816 00000100:00100000:2.0:1787790666.601204:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970816 00000100:00100000:2.0:1787790666.601342:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787790666.601349:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970816:12345-0@lo:503: 00000100:00100000:2.0:1787790666.601439:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970816:12345-0@lo:503: Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.601452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787790666.601936:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970816:0@lo:503: 00000040:00080000:3.0:1787790666.602220:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790666.602308:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970944:0@lo:502: 00000100:00100000:3.0:1787790666.602358:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.602393:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790666.602467:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267970944 00000100:00100000:0.0:1787790666.602540:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267970944 00000100:00100000:0.0:1787790666.602577:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787790666.602586:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970944:12345-0@lo:502: 00000100:00100000:0.0:1787790666.602676:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267970944:12345-0@lo:502: Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790666.602692:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790666.603966:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267970944:0@lo:502: 00000040:00080000:3.0:1787790666.604640:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787790666.604674:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787790666.604689:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787790666.604702:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787790666.604883:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787790666.604903:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787790666.604944:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971072:0@lo:502: 00000100:00100000:3.0:1787790666.605020:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.605103:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.605308:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971072 00000100:00100000:2.0:1787790666.605315:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971072 00000100:00100000:2.0:1787790666.605371:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787790666.605381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267971072:12345-0@lo:502: 00000100:00100000:2.0:1787790666.605534:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267971072:12345-0@lo:502: Request processed in 153us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.605542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790666.605618:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971072:0@lo:502: 00000040:00080000:3.0:1787790666.605663:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787790666.605672:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787790666.606534:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790666.606550:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787790666.606557:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790666.606559:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787790666.606565:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790666.606581:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9170eef319b8) 00000020:00000080:3.0:1787790666.606952:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787790666.606963:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787790666.607051:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f3c78800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787790666.607060:0:8443:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787790666.607273:0:8443:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf9477fddcf1d787 00010000:00010000:3.0:1787790666.612585:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787790666.613047:0:8443:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787790666.616557:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787790666.619416:0:8443:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787790666.624436:0:8443:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787790666.624620:0:8443:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787790666.628386:0:8443:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787790666.629885:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787790666.629897:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790666.629903:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790666.629905:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787790666.629907:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790666.629911:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790666.629912:0:8443:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790666.629915:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790666.629917:0:8443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787790666.629938:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790666.629941:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790666.629942:0:8443:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787790666.629945:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787790666.630243:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787790666.630278:0:8419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787790666.630301:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.630313:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790666.630322:0:8419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3c78800 from 1 10000000:01000000:1.0:1787790666.630325:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790666.630360:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.630368:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.630390:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.630412:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971200:0@lo:101: 00000100:00100000:1.0:1787790666.630474:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.630550:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a94d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.634304:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971200 00000100:00100000:2.0:1787790666.634318:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971200 00000100:00100000:2.0:1787790666.634372:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787790666.634382:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:8419:x1874634267971200:12345-0@lo:101: 00010000:00010000:2.0:1787790666.634405:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790666.634420:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d78e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.634445:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.634456:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.634464:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39000, rc 0) 00000100:00100000:2.0:1787790666.634543:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971200:12345-0@lo:101: Request processed in 161us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.634551:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790666.634571:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971200:0@lo:101: 00010000:00010000:3.0:1787790666.634593:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.634604:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.634743:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971328:0@lo:501: 00000100:00100000:3.0:1787790666.634799:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.634970:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971328 00000100:00100000:2.0:1787790666.634975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971328 00000100:00100000:2.0:1787790666.635009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787790666.635013:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.635019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971328:12345-0@lo:501: 00000100:00100000:2.0:1787790666.635119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971328:12345-0@lo:501: Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.635126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787790666.635146:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971328:0@lo:501: 00000100:00100000:3.0:1787790666.635184:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971456:0@lo:503: 00000100:00100000:3.0:1787790666.635227:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.635245:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.635421:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971456 00000100:00100000:2.0:1787790666.635425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971456 00000100:00100000:2.0:1787790666.635455:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787790666.635462:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971456:12345-0@lo:503: 00000100:00100000:2.0:1787790666.635544:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971456:12345-0@lo:503: Request processed in 81us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.635551:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787790666.635573:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971456:0@lo:503: 00000040:00080000:3.0:1787790666.636305:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790666.636394:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971584:0@lo:502: 00000100:00100000:3.0:1787790666.636441:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.636475:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2b3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.636809:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971584 00000100:00100000:2.0:1787790666.636815:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971584 00000100:00100000:2.0:1787790666.636847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787790666.636854:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971584:12345-0@lo:502: 00000100:00100000:2.0:1787790666.636951:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971584:12345-0@lo:502: Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.636959:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787790666.636989:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971584:0@lo:502: 00000040:00080000:3.0:1787790666.637190:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787790666.637233:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787790666.637260:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971712:0@lo:502: 00000100:00100000:3.0:1787790666.637312:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.637350:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790666.637767:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971712 00000100:00100000:1.0:1787790666.637773:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971712 00000100:00100000:1.0:1787790666.637805:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787790666.637813:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971712:12345-0@lo:502: 00000100:00100000:1.0:1787790666.637900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971712:12345-0@lo:502: Request processed in 88us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.637908:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787790666.637940:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971712:0@lo:502: 00000040:00080000:3.0:1787790666.637986:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787790666.637995:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787790666.639333:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790666.639345:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790666.639348:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787790666.639355:0:8447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f3c78800 00000020:00000080:3.0:1787790666.639358:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790666.639372:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790666.639375:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790666.639376:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787790666.639379:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787790666.639515:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787790666.639542:0:8419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790666.639596:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.639608:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790666.639664:0:8419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787790666.639667:0:8419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170f3c78800 10000000:01000000:0.0:1787790666.639670:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170f3c78800 10000000:01000000:0.0:1787790666.639674:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787790666.639680:0:8419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3c78800 from 1 10000000:01000000:0.0:1787790666.639683:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787790666.639984:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.639991:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.640000:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.640018:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971840:0@lo:101: 00000100:00100000:1.0:1787790666.640075:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.640114:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0a94300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.640165:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971840 00000100:00100000:2.0:1787790666.640171:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971840 00000100:00100000:2.0:1787790666.640217:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787790666.640228:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:8419:x1874634267971840:12345-0@lo:101: 00010000:00010000:2.0:1787790666.640242:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790666.640255:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d79c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.640279:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.640290:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.640298:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39e00, rc 0) 00000100:00100000:2.0:1787790666.640340:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267971840:12345-0@lo:101: Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.640345:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787790666.640436:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971840:0@lo:101: 00010000:00010000:0.0:1787790666.640449:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.640455:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.640530:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971968:0@lo:501: 00000100:00100000:0.0:1787790666.640565:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.640609:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.640699:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267971968 00000100:00100000:2.0:1787790666.640719:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267971968 00000100:00100000:2.0:1787790666.640741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787790666.640756:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267971968:12345-0@lo:501: 00000100:00100000:2.0:1787790666.640860:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267971968:12345-0@lo:501: Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.640867:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787790666.640976:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267971968:0@lo:501: 00000100:00100000:0.0:1787790666.640997:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267972096:0@lo:503: 00000100:00100000:0.0:1787790666.641660:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.641737:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790666.641881:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972096 00000100:00100000:3.0:1787790666.641886:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972096 00000100:00100000:3.0:1787790666.641920:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787790666.641925:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267972096:12345-0@lo:503: 00000100:00100000:3.0:1787790666.642008:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267972096:12345-0@lo:503: Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.642013:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787790666.642055:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267972096:0@lo:503: 00000040:00080000:3.0:1787790666.642263:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790666.642314:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267972224:0@lo:502: 00000100:00100000:3.0:1787790666.642341:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.642352:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790666.642362:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972224 00000100:00100000:3.0:1787790666.642364:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972224 00000100:00100000:3.0:1787790666.642377:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787790666.642382:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267972224:12345-0@lo:502: 00000100:00100000:3.0:1787790666.642450:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267972224:12345-0@lo:502: Request processed in 68us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.642455:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787790666.642482:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267972224:0@lo:502: 00000040:00080000:3.0:1787790666.642635:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787790666.642656:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787790666.642664:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787790666.642672:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787790666.642678:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787790666.642685:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787790666.642721:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787790666.642732:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787790666.642739:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787790666.642746:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787790666.642771:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787790666.642789:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787790666.642817:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787790666.642833:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787790666.642852:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787790666.642866:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787790666.642888:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787790666.642901:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787790666.642913:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787790666.642924:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787790666.642931:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787790666.642937:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787790666.642944:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787790666.642951:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787790666.642957:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787790666.642964:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787790666.642970:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787790666.642977:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787790666.642992:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787790666.643000:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787790666.643006:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787790666.643013:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787790666.643019:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787790666.643026:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787790666.643032:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787790666.643038:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787790666.643045:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1787790666.643059:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267972352:0@lo:502: 00000100:00100000:3.0:1787790666.643084:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.643111:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0c1c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.643124:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972352 00000100:00100000:2.0:1787790666.643128:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972352 00000100:00100000:2.0:1787790666.643162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787790666.643169:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267972352:12345-0@lo:502: 00000100:00100000:2.0:1787790666.643248:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267972352:12345-0@lo:502: Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.643255:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787790666.643298:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267972352:0@lo:502: 00000040:00080000:3.0:1787790666.643333:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787790666.643340:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787790666.643893:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787790666.643906:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9170fc130000) 00000020:00000080:0.0:1787790666.643929:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787790666.644006:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f3c78800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787790666.644009:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f3c78800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787790666.644012:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f3c78800 3 00010000:00080000:0.0:1787790666.644037:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc2418000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787790666.645626:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787790666.646220:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787790666.646265:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790666.646277:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf9477fddcf1d7b1 00000100:00080000:0.0:1787790666.646287:0:8448:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790666.646294:0:8448:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc2418000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790666.646330:0:8448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc1fb43c0 x1874634267972480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790666.646392:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634267972480:0@lo:38: 00000100:00100000:1.0:1787790666.646461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787790666.646519:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787790666.646787:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634267972608:0@lo:400: 00000100:00100000:1.0:1787790666.646815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.646861:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267972992:0@lo:400: 00000100:00100000:0.0:1787790666.647273:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267972736:0@lo:400: 00000100:00100000:0.0:1787790666.647305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.647333:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790666.647339:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267972864:0@lo:400: 00000100:00100000:0.0:1787790666.647358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.647504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.647564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972480 00000100:00100000:3.0:1787790666.647573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972480 00000100:00100000:3.0:1787790666.647603:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972608 00000100:00100000:3.0:1787790666.647606:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972608 00000100:00100000:3.0:1787790666.647643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790666.647652:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634267972608:12345-0@lo:400: 00000100:00100000:3.0:1787790666.647737:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634267972608:12345-0@lo:400: Request processed in 85us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.647745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790666.647772:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790666.647777:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634267972480:12345-0@lo:38: 00010000:00080000:3.0:1787790666.647797:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1787790666.647831:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf9477fddcf1d7b8 00000004:00100000:3.0:1787790666.647846:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787790666.647875:0:6513:0:(import.c:65:import_set_state_nolock()) ffff916fc1d59800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790666.647911:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874634267972480:12345-0@lo:38: Request processed in 133us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.647918:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790666.647938:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972736 00000100:00100000:3.0:1787790666.647941:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972736 00000100:00100000:3.0:1787790666.647962:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972864 00000100:00100000:3.0:1787790666.647965:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972864 00000100:00100000:3.0:1787790666.647977:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790666.647982:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267972736:12345-0@lo:400: 00000100:00100000:3.0:1787790666.648018:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267972736:12345-0@lo:400: Request processed in 35us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.648024:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790666.648035:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790666.648040:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267972864:12345-0@lo:400: 00000100:00100000:3.0:1787790666.648065:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267972864:12345-0@lo:400: Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.648078:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790666.648123:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267972864:0@lo:400: 00000100:00100000:3.0:1787790666.648132:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267972736:0@lo:400: 00010000:00080000:3.0:1787790666.648167:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc1fb43c0 x1874634267972480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790666.648176:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787790666.648181:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787790666.648188:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787790666.648192:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787790666.648195:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787790666.648200:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634267972480:0@lo:38: 00010000:00080000:3.0:1787790666.648223:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbe670c0 x1874634267972608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790666.648232:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634267972608:0@lo:400: 00000100:00100000:3.0:1787790666.650630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267972992 00000100:00100000:3.0:1787790666.650642:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267972992 00000100:00100000:3.0:1787790666.650688:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000020:01000004:1.0:1787790666.650896:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787790666.650912:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9170f52fcd28) 00000020:00000080:1.0:1787790666.650933:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1787790666.651017:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f3c78800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787790666.651022:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f3c78800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787790666.651024:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f3c78800 3 00010000:00080000:1.0:1787790666.651053:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f6779000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.122@tcp at head 00000100:00100000:3.0:1787790666.652969:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267972992:12345-0@lo:400: 00000100:00100000:3.0:1787790666.653070:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267972992:12345-0@lo:400: Request processed in 118us (5565us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790666.653616:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1787790666.654442:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787790666.654507:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbe66d00 x1874634267972992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790666.654525:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267972992:0@lo:400: 00000020:00000080:0.0:1787790666.655179:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787790666.655244:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787790666.655256:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf9477fddcf1d7c6 00000100:00080000:0.0:1787790666.655269:0:8448:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790666.655274:0:8448:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9170f6779000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790666.655302:0:8448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc1fb5a40 x1874634267973120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790666.655325:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787790666.655338:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634267973120:0@lo:38: 00000100:00100000:3.0:1787790666.656506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.656618:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973120 00000100:00100000:0.0:1787790666.656626:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973120 00000100:00100000:0.0:1787790666.656666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790666.656674:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634267973120:12345-0@lo:38: 00010000:00080000:0.0:1787790666.656798:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1787790666.656836:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf9477fddcf1d7cd 00000004:00100000:0.0:1787790666.656852:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787790666.656886:0:6512:0:(import.c:65:import_set_state_nolock()) ffff916fc241c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790666.656942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874634267973120:12345-0@lo:38: Request processed in 267us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790666.656949:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787790666.657046:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc1fb5a40 x1874634267973120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790666.657056:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787790666.657064:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787790666.657071:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787790666.657076:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787790666.657078:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f6779000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787790666.657084:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634267973120:0@lo:38: 00000040:00080000:0.0:1787790666.658068:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787790666.658195:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787790666.658226:0:8419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790666.658248:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.658257:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787790666.658302:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787790666.658304:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790666.658305:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790666.658307:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790666.658308:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790666.658309:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790666.658310:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790666.658312:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790666.658313:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790666.658315:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790666.658316:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787790666.658320:0:8419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787790666.658326:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790666.658327:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790666.658328:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790666.658329:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790666.658329:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790666.658330:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790666.658331:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790666.658332:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790666.658333:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790666.658334:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790666.658334:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787790666.658353:0:8419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787790666.658369:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267973248:0@lo:253: 00000100:00100000:3.0:1787790666.658436:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.658463:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790666.658517:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973248 00000100:00100000:0.0:1787790666.658523:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973248 00000100:00100000:0.0:1787790666.658563:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787790666.658572:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267973248:12345-0@lo:253: 20000000:01000000:0.0:1787790666.658595:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787790666.658607:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787790666.665001:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787790666.665027:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787790666.665465:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787790666.665471:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787790666.665493:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.665522:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.665529:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.665537:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.665575:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.665588:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.665602:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267973376:0@lo:104: 00000100:00100000:0.0:1787790666.665667:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790666.665733:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787790666.665747:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790666.665759:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973376 00010000:00010000:0.0:1787790666.665765:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 16 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790666.665766:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973376 00000100:00100000:0.0:1787790666.665773:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267973504:0@lo:104: 00000100:00100000:0.0:1787790666.665794:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790666.667052:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:8419:x1874634267973248:12345-0@lo:253: Request processed in 8475us (8610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790666.667065:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787790666.667128:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:8419:1874634267973248:0@lo:253: 10000000:01000000:3.0:1787790666.667140:0:8419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787790666.667144:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787790666.667145:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790666.667147:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790666.667148:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790666.667149:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790666.667151:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790666.667152:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790666.667153:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787790666.667155:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787790666.667156:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790666.667158:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787790666.667172:0:8419:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787790666.667482:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790666.671404:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973504 00000100:00100000:2.0:1787790666.671419:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973504 00000100:00100000:1.0:1787790666.671970:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790666.671984:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6528:x1874634267973376:12345-0@lo:104: 00010000:00010000:1.0:1787790666.672002:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.672461:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790666.672466:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6528:x1874634267973376:12345-0@lo:104: Request processed in 488us (6800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.672472:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787790666.672507:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790666.672512:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.672518:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790666.672521:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.672527:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790666.672538:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790666.672543:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790666.672571:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.672574:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790666.672587:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.672592:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1d717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d71e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.672601:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790666.672602:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790666.672603:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790666.672617:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267973632:0@lo:103: 00000100:00100000:1.0:1787790666.672645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790666.672678:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973632 00000100:00100000:1.0:1787790666.672681:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973632 00000100:00100000:0.0:1787790666.672824:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267973376:0@lo:104: 00010000:00010000:1.0:1787790666.672966:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790666.672992:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790666.673000:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+16:3639:x1874634267973632:12345-0@lo:103: 00010000:00010000:1.0:1787790666.673010:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790666.673016:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.673032:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.673045:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102179e00/0xcf9477fddcf1d71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d717 expref: 16 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790666.673056:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790666.673090:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+15:3639:x1874634267973632:12345-0@lo:103: Request processed in 92us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790666.673097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790666.673151:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790666.673160:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267973504:12345-0@lo:104: 00010000:00010000:2.0:1787790666.673171:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790666.673230:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790666.673237:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267973504:12345-0@lo:104: Request processed in 78us (7442us total) trans 0 rc 0/0 00010000:00010000:3.0:1787790666.673239:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790666.673248:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.673264:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790666.673267:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.673274:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790666.673280:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.673281:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267973632:0@lo:103: 10000000:01000000:3.0:1787790666.673286:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787790666.673316:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267973504:0@lo:104: 00010000:00010000:3.0:1787790666.673318:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.673324:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790666.673331:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.673337:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.673343:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1d709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d710 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790666.673357:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.673359:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790666.673361:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790666.673373:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267973760:0@lo:103: 00000100:00100000:3.0:1787790666.673478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790666.673512:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973760 00000100:00100000:0.0:1787790666.673516:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973760 00010000:00010000:0.0:1787790666.673532:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 15 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790666.673562:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790666.673569:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+15:3640:x1874634267973760:12345-0@lo:103: 00010000:00010000:0.0:1787790666.673576:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790666.673580:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 15 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673588:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 15 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673598:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d709 expref: 15 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673609:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673617:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787790666.673625:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 20000000:01000000:0.0:1787790666.673630:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008159108s 00010000:00010000:0.0:1787790666.673634:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673650:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673656:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673663:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673668:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790666.673672:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673680:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673695:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673722:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790666.673769:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+14:3640:x1874634267973760:12345-0@lo:103: Request processed in 200us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790666.673774:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790666.673781:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787790666.673805:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673813:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790666.673820:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d7d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790666.673854:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267973760:0@lo:103: 00080000:10000000:3.0:1787790666.674009:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787790666.674167:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787790666.674331:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787790666.674515:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787790666.674664:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787790666.676112:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787790666.681570:0:8419:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787790666.681580:0:8419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787790666.681616:0:8419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787790666.681654:0:8419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787790666.681676:0:8419:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787790666.681726:0:8419:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787790666.682480:0:8419:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790666.682640:0:8419:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1787790667.315616:0:8504:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790667.318503:0:8504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787790667.594894:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790668.625146:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787790669.201287:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787790669.201296:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3e20800 from 30 10000000:01000000:0.0:1787790669.201302:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787790669.201348:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.201361:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.201372:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790669.201498:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267973888:0@lo:101: 00000100:00100000:0.0:1787790669.201578:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.202218:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.207920:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267973888 00000100:00100000:3.0:1787790669.207939:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267973888 00000100:00100000:3.0:1787790669.208131:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787790669.208143:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+14:6509:x1874634267973888:12345-0@lo:101: 00010000:00010000:3.0:1787790669.208161:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790669.208195:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d7db expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.208226:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.208237:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.208265:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e000, rc 0) 00000100:00100000:3.0:1787790669.208350:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267973888:12345-0@lo:101: Request processed in 209us (6771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.208357:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787790669.208413:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267973888:0@lo:101: 00010000:00010000:3.0:1787790669.208433:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.208443:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.208520:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974016:0@lo:501: 00000100:00100000:3.0:1787790669.208555:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.208582:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82300 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.208595:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974016 00000100:00100000:3.0:1787790669.208598:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974016 00000100:00100000:3.0:1787790669.208619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787790669.208624:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267974016:12345-0@lo:501: 00000100:00100000:3.0:1787790669.208771:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267974016:12345-0@lo:501: Request processed in 145us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.208778:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787790669.210320:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974016:0@lo:501: 00000100:00100000:3.0:1787790669.210372:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974144:0@lo:503: 00000100:00100000:3.0:1787790669.210433:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.210466:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82300 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.210488:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974144 00000100:00100000:3.0:1787790669.210493:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974144 00000100:00100000:3.0:1787790669.210527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790669.210534:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267974144:12345-0@lo:503: 00000100:00100000:3.0:1787790669.210634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267974144:12345-0@lo:503: Request processed in 99us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.210641:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790669.210683:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974144:0@lo:503: 00000100:00100000:3.0:1787790669.213433:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8624:1874634267974272:0@lo:502: 00000100:00100000:3.0:1787790669.213515:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.213549:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974272 00000100:00100000:3.0:1787790669.213555:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974272 00000100:00100000:3.0:1787790669.213591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787790669.213600:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8624:x1874634267974272:12345-0@lo:502: 00000100:00100000:3.0:1787790669.213747:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:8624:x1874634267974272:12345-0@lo:502: Request processed in 146us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.213755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787790669.213815:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82300 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.213835:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8624:1874634267974272:0@lo:502: 00000100:00100000:3.0:1787790669.213880:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8624:1874634267974400:0@lo:502: 00000100:00100000:3.0:1787790669.213914:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.213938:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.214263:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974400 00000100:00100000:1.0:1787790669.214267:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974400 00000100:00100000:1.0:1787790669.214451:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787790669.214459:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:8624:x1874634267974400:12345-0@lo:502: 00000100:00100000:1.0:1787790669.214539:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:8624:x1874634267974400:12345-0@lo:502: Request processed in 81us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.214546:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787790669.214979:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8624:1874634267974400:0@lo:502: 00000040:00080000:3.0:1787790669.215003:0:8624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787790669.215069:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787790669.215088:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790669.215103:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.215113:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790669.215123:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787790669.215126:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f3e20800 from 5 10000000:01000000:3.0:1787790669.215128:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787790669.215156:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.215164:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.215745:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.215768:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974528:0@lo:101: 00000100:00100000:3.0:1787790669.215890:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.215922:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.215941:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974528 00000100:00100000:3.0:1787790669.215947:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974528 00000100:00100000:3.0:1787790669.215989:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787790669.215997:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267974528:12345-0@lo:101: 00010000:00010000:3.0:1787790669.216008:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790669.216022:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d7e9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.216046:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.216062:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.216070:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:3.0:1787790669.216103:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267974528:12345-0@lo:101: Request processed in 107us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.219897:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787790669.219992:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974528:0@lo:101: 00010000:00010000:3.0:1787790669.220021:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.220123:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.220400:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974656:0@lo:256: 00000100:00100000:3.0:1787790669.220462:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.220497:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.220513:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974656 00000100:00100000:3.0:1787790669.220518:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974656 00000100:00100000:3.0:1787790669.220550:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787790669.220558:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267974656:12345-0@lo:256: 20000000:01000000:3.0:1787790669.220576:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787790669.220590:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787790669.220593:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787790669.220663:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267974656:12345-0@lo:256: Request processed in 105us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.220670:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787790669.220700:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974656:0@lo:256: 10000000:01000000:3.0:1787790669.220766:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787790669.220773:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.220782:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790669.221360:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787790669.221364:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787790669.221368:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787790669.221393:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.221402:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.221411:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.221425:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974784:0@lo:101: 00000100:00100000:3.0:1787790669.221455:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.221486:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.221501:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974784 00000100:00100000:3.0:1787790669.221504:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974784 00000100:00100000:3.0:1787790669.221528:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787790669.221534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267974784:12345-0@lo:101: 00010000:00010000:3.0:1787790669.221544:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790669.221555:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d7f7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.221579:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.221589:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.221599:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fa00, rc 0) 00000100:00100000:3.0:1787790669.221631:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267974784:12345-0@lo:101: Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.221637:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787790669.221902:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974784:0@lo:101: 00010000:00010000:2.0:1787790669.221916:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790669.221925:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790669.221989:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974912:0@lo:501: 00000100:00100000:2.0:1787790669.222016:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790669.222600:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.225516:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267974912 00000100:00100000:1.0:1787790669.225532:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267974912 00000100:00100000:1.0:1787790669.225586:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787790669.225596:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267974912:12345-0@lo:501: 00000100:00100000:1.0:1787790669.225797:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267974912:12345-0@lo:501: Request processed in 202us (3778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.225806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787790669.225885:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267974912:0@lo:501: 00000100:00100000:2.0:1787790669.225936:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267975040:0@lo:503: 00000100:00100000:2.0:1787790669.226150:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790669.226175:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.226483:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975040 00000100:00100000:3.0:1787790669.226488:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975040 00000100:00100000:3.0:1787790669.226535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790669.226543:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267975040:12345-0@lo:503: 00000100:00100000:3.0:1787790669.226635:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267975040:12345-0@lo:503: Request processed in 92us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.226643:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787790669.227122:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267975040:0@lo:503: 00000100:00100000:2.0:1787790669.228018:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8626:1874634267975168:0@lo:502: 00000100:00100000:2.0:1787790669.228081:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790669.228120:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.228170:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975168 00000100:00100000:3.0:1787790669.228237:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975168 00000100:00100000:3.0:1787790669.228271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787790669.228279:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:8626:x1874634267975168:12345-0@lo:502: 00000100:00100000:3.0:1787790669.228372:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:8626:x1874634267975168:12345-0@lo:502: Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.228380:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790669.228396:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8626:1874634267975168:0@lo:502: 00000020:01000000:2.0:1787790669.228419:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787790669.228428:0:8626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787790669.228435:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790669.228438:0:8626:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787790669.228443:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787790669.228447:0:8626:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:2.0:1787790669.228468:0:8626:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787790669.228477:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790669.228503:0:8626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9170fbee8000) 00000020:00000080:2.0:1787790669.228524:0:8626:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787790669.228530:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787790669.228604:0:8626:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787790669.228611:0:8626:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787790669.228618:0:8626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1d80c 00010000:00080000:2.0:1787790669.228653:0:8626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f67a6800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787790669.230572:0:8626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787790669.248955:0:8626:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787790669.248989:0:8626:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787790669.249247:0:8626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790669.249476:0:8626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790669.249561:0:8626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787790669.249655:0:8626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787790669.250689:0:8630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790669.250696:0:8630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787790669.251821:0:8626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787790669.251835:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787790669.252015:0:8626:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787790669.252046:0:8626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d813 00000100:00080000:0.0:1787790669.252060:0:8626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790669.252068:0:8626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170f67a6800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790669.252242:0:8626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc1fb70c0 x1874634267975296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790669.252324:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634267975296:0@lo:8: 00000100:00100000:3.0:1787790669.252466:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787790669.252580:0:8626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787790669.252671:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267975552:0@lo:400: 00000100:00100000:0.0:1787790669.252702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.252753:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634267976064:0@lo:400: 00000100:00100000:0.0:1787790669.252780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.252798:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790669.252803:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267975680:0@lo:400: 00000100:00100000:0.0:1787790669.252822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787790669.252902:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790669.252907:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790669.252909:0:8626:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787790669.252911:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790669.252915:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790669.252917:0:8626:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787790669.252919:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787790669.252921:0:8626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787790669.252943:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8626:1874634267976192:0@lo:502: 00000100:00100000:0.0:1787790669.252984:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.253004:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.253363:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975296 00000100:00100000:1.0:1787790669.253378:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975296 00000100:00100000:1.0:1787790669.253515:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790669.253524:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874634267975296:12345-0@lo:8: 00010000:00080000:1.0:1787790669.253550:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1787790669.253578:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d81a 00002000:00100000:1.0:1787790669.253614:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9170f677b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787790669.253618:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1787790669.253622:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787790669.253679:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790669.253964:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787790669.253993:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9170f6779800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790669.254481:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634267975296:12345-0@lo:8: Request processed in 955us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.254491:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787790669.254575:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb70c0 x1874634267975296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.254589:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787790669.254600:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787790669.254608:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787790669.254613:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787790669.254616:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67a6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787790669.254689:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787790669.254696:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634267975296:0@lo:8: 00000100:00100000:3.0:1787790669.254761:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267975424:0@lo:400: 00000100:00100000:3.0:1787790669.254801:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.254826:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634267975936:0@lo:400: 00000100:00100000:3.0:1787790669.254861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.254997:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790669.255005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267975808:0@lo:400: 00000100:00100000:3.0:1787790669.255030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.255059:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975552 00000100:00100000:3.0:1787790669.255064:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975552 00000100:00100000:3.0:1787790669.255109:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975680 00000100:00100000:3.0:1787790669.255113:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975680 00000100:00100000:3.0:1787790669.255130:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790669.255137:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267975552:12345-0@lo:400: 00000100:00100000:3.0:1787790669.255310:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267975552:12345-0@lo:400: Request processed in 172us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.255317:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790669.255331:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790669.255338:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267975680:12345-0@lo:400: 00000100:00100000:3.0:1787790669.255377:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267975680:12345-0@lo:400: Request processed in 39us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.255383:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790669.255413:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976064 00000100:00100000:3.0:1787790669.255418:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976064 00000100:00100000:3.0:1787790669.255455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975424 00000100:00100000:3.0:1787790669.255458:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975424 00000100:00100000:3.0:1787790669.255468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975936 00000100:00100000:3.0:1787790669.255471:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975936 00000100:00100000:3.0:1787790669.255483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267975808 00000100:00100000:3.0:1787790669.255485:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267975808 00000100:00100000:3.0:1787790669.255497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790669.255503:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634267976064:12345-0@lo:400: 00000100:00100000:3.0:1787790669.255535:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634267976064:12345-0@lo:400: Request processed in 32us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.255541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790669.255552:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790669.255557:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267975424:12345-0@lo:400: 00000100:00100000:3.0:1787790669.255588:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267975424:12345-0@lo:400: Request processed in 30us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.255594:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790669.255605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790669.255610:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634267975936:12345-0@lo:400: 00000100:00100000:3.0:1787790669.255637:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634267975936:12345-0@lo:400: Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.255643:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790669.255653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787790669.255659:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267975808:12345-0@lo:400: 00000100:00100000:3.0:1787790669.255692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267975808:12345-0@lo:400: Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.255698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787790669.255789:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb52c0 x1874634267975808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.255801:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267975808:0@lo:400: 00010000:00080000:3.0:1787790669.255813:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb6580 x1874634267975424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.255821:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267975424:0@lo:400: 00010000:00080000:3.0:1787790669.255828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb6d00 x1874634267975936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.256022:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634267975936:0@lo:400: 00000100:00100000:3.0:1787790669.256061:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267975680:0@lo:400: 00000100:00100000:3.0:1787790669.256072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267975552:0@lo:400: 00010000:00080000:3.0:1787790669.256084:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb4f00 x1874634267976064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.256160:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634267976064:0@lo:400: 00000100:00100000:3.0:1787790669.256261:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976192 00000100:00100000:3.0:1787790669.256266:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976192 00000100:00100000:3.0:1787790669.256298:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787790669.256304:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:8626:x1874634267976192:12345-0@lo:502: 00000100:00100000:3.0:1787790669.256481:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:8626:x1874634267976192:12345-0@lo:502: Request processed in 176us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.256495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:0.0:1787790669.256649:0:8630:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787790669.256736:0:8630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 218205029510ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787790669.256744:0:8630:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787790669.256785:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8626:1874634267976192:0@lo:502: 00000020:01000000:0.0:1787790669.256810:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790669.256817:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790669.256819:0:8626:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787790669.256823:0:8626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787790669.257165:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787790669.257247:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787790669.257258:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.257267:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790669.257277:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787790669.257280:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170c2ab0800 from 30 10000000:01000000:3.0:1787790669.257283:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790669.257311:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.257320:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.257329:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.257346:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267976320:0@lo:101: 00000100:00100000:3.0:1787790669.257387:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.257492:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.258003:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976320 00000100:00100000:0.0:1787790669.258017:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976320 00000100:00100000:0.0:1787790669.258055:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787790669.258063:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267976320:12345-0@lo:101: 00010000:00010000:0.0:1787790669.258073:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790669.258085:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d821 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.258122:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.258134:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.258143:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031000, rc 0) 00000100:00100000:0.0:1787790669.258309:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267976320:12345-0@lo:101: Request processed in 246us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.258316:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787790669.258598:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267976320:0@lo:101: 00010000:00010000:3.0:1787790669.258612:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.258622:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787790669.258767:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790669.258772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790669.258916:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267976448:0@lo:700: 00000100:00100000:1.0:1787790669.258955:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.259049:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267976576:0@lo:501: 00000100:00100000:3.0:1787790669.259075:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.259108:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76480 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.259132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976576 00000100:00100000:3.0:1787790669.259136:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976576 00000100:00100000:3.0:1787790669.259161:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787790669.259167:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267976576:12345-0@lo:501: 00000100:00100000:3.0:1787790669.259379:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267976576:12345-0@lo:501: Request processed in 211us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.259386:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787790669.259477:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267976576:0@lo:501: 00000100:00100000:3.0:1787790669.259502:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267976704:0@lo:503: 00000100:00100000:3.0:1787790669.259537:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.259551:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76480 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.259562:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976704 00000100:00100000:3.0:1787790669.259565:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976704 00000100:00100000:3.0:1787790669.259597:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787790669.259630:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267976704:12345-0@lo:503: 00000100:00100000:3.0:1787790669.259748:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267976704:12345-0@lo:503: Request processed in 144us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.259755:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787790669.259807:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267976704:0@lo:503: 00000004:00080000:3.0:1787790669.260241:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787790669.260353:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.260574:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976448 00000100:00100000:0.0:1787790669.260580:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976448 00000100:00100000:0.0:1787790669.260663:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790669.260672:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8631:x1874634267976448:12345-0@lo:700: 00000100:00100000:0.0:1787790669.260722:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8434:1874634267976832:0@lo:700: 00000100:00100000:0.0:1787790669.260772:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.260789:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9d000 going to sleep for 11 seconds 00000100:00080000:0.0:1787790669.260799:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790669.260931:0:8633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8633:1874634267976960:0@lo:502: 00000100:00100000:1.0:1787790669.260968:0:8633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.260998:0:8633:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.261107:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976960 00000100:00100000:0.0:1787790669.261110:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976960 00000100:00100000:0.0:1787790669.261148:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787790669.261155:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:8633:x1874634267976960:12345-0@lo:502: 00000100:00100000:0.0:1787790669.261258:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+18:8633:x1874634267976960:12345-0@lo:502: Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.261265:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787790669.261514:0:8633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8633:1874634267976960:0@lo:502: 00000100:00100000:1.0:1787790669.261560:0:8633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8633:1874634267977088:0@lo:502: 00000100:00100000:1.0:1787790669.261594:0:8633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.261619:0:8633:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.261954:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977088 00000100:00100000:0.0:1787790669.261959:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977088 00000100:00100000:0.0:1787790669.261992:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787790669.261999:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:8633:x1874634267977088:12345-0@lo:502: 00000100:00100000:0.0:1787790669.262071:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:8633:x1874634267977088:12345-0@lo:502: Request processed in 72us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.262078:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787790669.262218:0:8633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8633:1874634267977088:0@lo:502: 00000040:00080000:1.0:1787790669.262238:0:8633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787790669.262529:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787790669.262548:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787790669.262558:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.262570:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790669.262580:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790669.262582:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170c2ab0800 from 5 10000000:01000000:0.0:1787790669.262585:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790669.262611:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.262619:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.262639:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790669.262653:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977216:0@lo:101: 00000100:00100000:0.0:1787790669.262684:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.262748:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.262806:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977216 00000100:00100000:1.0:1787790669.262811:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977216 00000100:00100000:1.0:1787790669.262936:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787790669.262945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267977216:12345-0@lo:101: 00010000:00010000:1.0:1787790669.262955:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790669.262969:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d82f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.262991:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.263001:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.263010:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e0200, rc 0) 00000100:00100000:1.0:1787790669.263044:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267977216:12345-0@lo:101: Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.263049:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787790669.263132:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267976832 00000100:00100000:3.0:1787790669.263143:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267976832 00000100:00100000:3.0:1787790669.263185:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790669.263192:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8434:x1874634267976832:12345-0@lo:700: 00000100:00100000:0.0:1787790669.263555:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977216:0@lo:101: 00010000:00010000:0.0:1787790669.263568:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.263577:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790669.263623:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977344:0@lo:256: 00000100:00100000:0.0:1787790669.263661:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.263684:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.263697:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977344 00000100:00100000:0.0:1787790669.263700:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977344 00000100:00100000:0.0:1787790669.264988:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787790669.265000:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267977344:12345-0@lo:256: 20000000:01000000:0.0:1787790669.265022:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790669.265040:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790669.265043:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787790669.265518:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267977344:12345-0@lo:256: Request processed in 518us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.265525:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787790669.265579:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977344:0@lo:256: 10000000:01000000:0.0:1787790669.265627:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790669.265636:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.265645:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790669.265653:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787790669.265656:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787790669.265658:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787790669.265685:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.265693:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.265701:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790669.265752:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977472:0@lo:101: 00000100:00100000:0.0:1787790669.265783:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.265811:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.266281:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977472 00000100:00100000:1.0:1787790669.266288:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977472 00000100:00100000:1.0:1787790669.266327:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787790669.266336:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267977472:12345-0@lo:101: 00010000:00010000:1.0:1787790669.266346:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790669.266358:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d83d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.266380:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.266391:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.266472:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e1e00, rc 0) 00000100:00100000:1.0:1787790669.266509:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267977472:12345-0@lo:101: Request processed in 174us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.266515:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787790669.267464:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977472:0@lo:101: 00010000:00010000:0.0:1787790669.267487:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.267497:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790669.267570:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977600:0@lo:501: 00000100:00100000:0.0:1787790669.267602:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.267638:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe9d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.267739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977600 00000100:00100000:1.0:1787790669.267745:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977600 00000100:00100000:1.0:1787790669.267775:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787790669.267783:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267977600:12345-0@lo:501: 00000100:00100000:1.0:1787790669.268564:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267977600:12345-0@lo:501: Request processed in 778us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.268573:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787790669.268652:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977600:0@lo:501: 00000100:00100000:2.0:1787790669.268690:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977728:0@lo:503: 00000100:00100000:2.0:1787790669.268766:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790669.268794:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.269264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977728 00000100:00100000:1.0:1787790669.269269:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977728 00000100:00100000:1.0:1787790669.269301:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787790669.269308:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267977728:12345-0@lo:503: 00000100:00100000:1.0:1787790669.269384:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267977728:12345-0@lo:503: Request processed in 76us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.269391:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787790669.269498:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267977728:0@lo:503: 00000100:00100000:1.0:1787790669.270303:0:8634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8634:1874634267977856:0@lo:502: 00000100:00100000:1.0:1787790669.270347:0:8634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.270380:0:8634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d1189f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.270666:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977856 00000100:00100000:0.0:1787790669.270671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977856 00000100:00100000:0.0:1787790669.270753:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787790669.270762:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:8634:x1874634267977856:12345-0@lo:502: 00000100:00100000:0.0:1787790669.271325:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:8634:x1874634267977856:12345-0@lo:502: Request processed in 562us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.271333:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787790669.271498:0:8634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8634:1874634267977856:0@lo:502: 00000020:01000000:1.0:1787790669.271524:0:8634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787790669.271532:0:8634:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787790669.271538:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790669.271544:0:8634:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787790669.271549:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787790669.271553:0:8634:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:1.0:1787790669.271572:0:8634:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787790669.271575:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790669.271588:0:8634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9170f52fb370) 00000020:00000080:1.0:1787790669.271607:0:8634:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1787790669.271611:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787790669.271698:0:8634:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787790669.271721:0:8634:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787790669.271740:0:8634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d852 00010000:00080000:1.0:1787790669.271779:0:8634:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f67c9000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790669.272009:0:8634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:2.0:1787790669.277165:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:0.0:1787790669.287637:0:8634:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787790669.287670:0:8634:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787790669.287961:0:8634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790669.288164:0:8634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790669.288254:0:8634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787790669.288356:0:8634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1787790669.290664:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8434:x1874634267976832:12345-0@lo:700: Request processed in 27461us (29880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790669.290682:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787790669.291205:0:8434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb4000 x1874634267976832/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790669.291220:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8434:1874634267976832:0@lo:700: 40000000:02000000:1.0:1787790669.291236:0:8434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:00080000:0.0:1787790669.299019:0:8636:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790669.299032:0:8636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787790669.304580:0:8634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790669.304596:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787790669.304634:0:8634:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787790669.304660:0:8634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d859 00000100:00080000:2.0:1787790669.304671:0:8634:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787790669.304677:0:8634:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170f67c9000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790669.304954:0:8634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4f461c0 x1874634267977984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00100000:3.0:1787790669.304978:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787790669.305011:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267977984:0@lo:8: 00000100:00100000:0.0:1787790669.305094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.305229:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8631:x1874634267976448:12345-0@lo:700: Request processed in 44556us (46271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.305256:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787790669.305370:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe67840 x1874634267976448/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.305387:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267976448:0@lo:700: 00000100:00100000:0.0:1787790669.305500:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267977984 00000100:00100000:0.0:1787790669.305507:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267977984 00000100:00100000:0.0:1787790669.305571:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790669.305579:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874634267977984:12345-0@lo:8: 00010000:00080000:0.0:1787790669.305606:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1787790669.305633:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d860 00002000:00100000:0.0:1787790669.305648:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff916fc241e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787790669.305657:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787790669.305660:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787790669.305771:0:8634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787790669.305867:0:8634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790669.305873:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790669.305875:0:8634:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787790669.305878:0:8634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790669.305882:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790669.305884:0:8634:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790669.305886:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790669.305888:0:8634:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787790669.305915:0:8634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8634:1874634267978112:0@lo:502: 00000100:00100000:2.0:1787790669.305964:0:8634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790669.306004:0:8634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790669.306117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978112 00002000:00080000:0.0:1787790669.306117:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787790669.306146:0:8428:0:(import.c:65:import_set_state_nolock()) ffff916fc241b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790669.306222:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978112 00000100:00100000:0.0:1787790669.306241:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634267977984:12345-0@lo:8: Request processed in 660us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.306250:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790669.306337:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787790669.306347:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:8634:x1874634267978112:12345-0@lo:502: 00010000:00080000:2.0:1787790669.306356:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f461c0 x1874634267977984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790669.306475:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790669.306483:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787790669.306491:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787790669.306496:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787790669.306499:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67c9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787790669.306542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:8634:x1874634267978112:12345-0@lo:502: Request processed in 196us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.306552:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787790669.306567:0:8634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:8634:1874634267978112:0@lo:502: 00000020:01000000:1.0:1787790669.306597:0:8634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790669.306602:0:8634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790669.306603:0:8634:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787790669.306608:0:8634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1787790669.306798:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787790669.306806:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267977984:0@lo:8: 00000004:00080000:1.0:1787790669.306886:0:8636:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787790669.306942:0:8636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 218255236145ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787790669.306950:0:8636:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1787790669.308351:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787790669.308386:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787790669.308397:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.308481:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790669.308494:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787790669.308497:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9170d6383370 from 1 10000000:01000000:3.0:1787790669.308500:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787790669.308534:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.308554:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.308565:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.308587:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267978240:0@lo:101: 00000100:00100000:3.0:1787790669.308665:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.308739:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b769c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787790669.309062:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787790669.309160:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978240 00000100:00100000:0.0:1787790669.309168:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978240 00000100:00100000:0.0:1787790669.309217:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787790669.309228:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267978240:12345-0@lo:101: 00010000:00010000:0.0:1787790669.309240:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790669.309254:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d867 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.309280:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.309291:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790669.309300:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031200, rc 0) 00000100:00100000:0.0:1787790669.309355:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267978240:12345-0@lo:101: Request processed in 129us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790669.309362:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787790669.309401:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267978240:0@lo:101: 00010000:00010000:3.0:1787790669.309429:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790669.309439:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790669.309490:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267978368:0@lo:501: 00000100:00100000:3.0:1787790669.309517:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.309544:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790669.309599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978368 00000100:00100000:0.0:1787790669.309604:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978368 00000100:00100000:0.0:1787790669.309633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787790669.309641:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267978368:12345-0@lo:501: 00000100:00100000:0.0:1787790669.309774:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267978368:12345-0@lo:501: Request processed in 134us (255us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790669.309782:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787790669.309864:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267978368:0@lo:501: 10000000:01000000:1.0:1787790669.309899:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787790669.309907:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790669.309915:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790669.318288:0:8631:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787790669.318324:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267978624:0@lo:7: 00000100:00100000:0.0:1787790669.318481:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267978496:0@lo:13: 00000100:00100000:0.0:1787790669.318520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.318582:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.318623:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.318646:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978624 00000100:00100000:1.0:1787790669.318652:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978624 00000100:00100000:1.0:1787790669.318764:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790669.318774:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8631:x1874634267978624:12345-0@lo:7: 00000100:00100000:3.0:1787790669.322759:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978496 00000100:00100000:3.0:1787790669.322774:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978496 00000100:00100000:3.0:1787790669.322850:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790669.322861:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874634267978496:12345-0@lo:13: 00002000:00000024:3.0:1787790669.322892:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923857408 avail 3692335104 00000100:00100000:3.0:1787790669.322986:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874634267978496:12345-0@lo:13: Request processed in 126us (4464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.322993:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787790669.323032:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe64780 x1874634267978496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790669.323056:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267978496:0@lo:13: 00002000:00080000:1.0:1787790669.324532:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787790669.324540:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787790669.324623:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8631:x1874634267978624:12345-0@lo:7: Request processed in 5848us (6224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.324633:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787790669.324793:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe65e00 x1874634267978624/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.324806:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267978624:0@lo:7: 00000004:00080000:3.0:1787790669.324821:0:8631:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787790669.324859:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267978752:0@lo:5: 00000100:00100000:3.0:1787790669.324896:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.324923:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.325053:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978752 00000100:00100000:1.0:1787790669.325059:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978752 00000100:00100000:1.0:1787790669.325098:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790669.325107:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8631:x1874634267978752:12345-0@lo:5: 00002000:00080000:1.0:1787790669.325146:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787790669.325185:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8631:x1874634267978752:12345-0@lo:5: Request processed in 79us (288us total) trans 0 rc 0/0 00010000:00080000:3.0:1787790669.325196:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebe580 x1874634267978752/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790669.325211:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790669.325215:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267978752:0@lo:5: 00000004:00080000:3.0:1787790669.325227:0:8631:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787790669.325250:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267978880:0@lo:5: 00000100:00100000:3.0:1787790669.325287:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.325305:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.325317:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267978880 00000100:00100000:1.0:1787790669.325323:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267978880 00000100:00100000:1.0:1787790669.325354:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790669.325361:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8631:x1874634267978880:12345-0@lo:5: 00002000:00080000:1.0:1787790669.325381:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787790669.328043:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8631:x1874634267978880:12345-0@lo:5: Request processed in 2671us (2743us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787790669.328062:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787790669.328193:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebe580 x1874634267978880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.328209:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8631:1874634267978880:0@lo:5: 00000004:00080000:3.0:1787790669.328225:0:8631:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787790669.328275:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8631:1874634267979008:0@lo:900: 00000100:00100000:3.0:1787790669.328319:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.328344:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267979136:0@lo:13: 00000100:00100000:3.0:1787790669.328353:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.328509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790669.328587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979008 00000100:00100000:2.0:1787790669.328595:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979008 00000100:00100000:3.0:1787790669.328613:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979136 00000100:00100000:3.0:1787790669.328619:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979136 00000100:00100000:2.0:1787790669.328643:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790669.328656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8631:x1874634267979008:12345-0@lo:900: 00000100:00100000:3.0:1787790669.328671:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790669.328681:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634267979136:12345-0@lo:13: 00002000:00000024:3.0:1787790669.328749:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1787790669.328754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8631:x1874634267979008:12345-0@lo:900: Request processed in 101us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790669.328764:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:0.0:1787790669.328834:0:8637:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787790669.328867:0:8637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979264:0@lo:7: 00000100:00100000:0.0:1787790669.329051:0:8637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.329075:0:8637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790669.329139:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979264 00000100:00100000:2.0:1787790669.329144:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979264 00000100:00100000:2.0:1787790669.329175:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790669.329183:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8637:x1874634267979264:12345-0@lo:7: 00000100:00080000:0.0:1787790669.331801:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787790669.334814:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787790669.334824:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787790669.334929:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8637:x1874634267979264:12345-0@lo:7: Request processed in 5741us (5870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790669.334943:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787790669.335205:0:8637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb4f00 x1874634267979264/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790669.335221:0:8637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979264:0@lo:7: 00000004:00080000:0.0:1787790669.335236:0:8637:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787790669.335277:0:8637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979392:0@lo:5: 00000100:00100000:0.0:1787790669.335314:0:8637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790669.335350:0:8637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790669.335528:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979392 00000100:00100000:2.0:1787790669.335535:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979392 00000100:00100000:3.0:1787790669.335568:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634267979136:12345-0@lo:13: Request processed in 6885us (7055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790669.335580:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790669.335587:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790669.335599:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8637:x1874634267979392:12345-0@lo:5: 00002000:00080000:2.0:1787790669.335631:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787790669.335636:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1787790669.335653:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634267979008/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.335665:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8631:1874634267979008:0@lo:900: 00010000:00080000:1.0:1787790669.336313:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb43c0 x1874634267979136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790669.336332:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267979136:0@lo:13: 00000001:00080000:2.0:1787790669.346983:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1787790669.347005:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787790669.347014:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787790669.349979:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8637:x1874634267979392:12345-0@lo:5: Request processed in 14369us (14651us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787790669.349995:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787790669.352068:0:8637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc1fb4f00 x1874634267979392/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.352085:0:8637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787790669.352092:0:8637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979392:0@lo:5: 00000004:00080000:3.0:1787790669.352111:0:8637:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787790669.352175:0:8637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979520:0@lo:700: 00000100:00100000:3.0:1787790669.352233:0:8637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790669.352268:0:8637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790669.352355:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979520 00000100:00100000:1.0:1787790669.352362:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979520 00000100:00100000:1.0:1787790669.352435:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790669.352445:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8637:x1874634267979520:12345-0@lo:700: 00000100:00100000:1.0:1787790669.360285:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8637:x1874634267979520:12345-0@lo:700: Request processed in 7832us (8042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790669.360300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790669.364176:0:8637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634267979520/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.364196:0:8637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979520:0@lo:700: 00000004:02000040:1.0:1787790669.366291:0:8637:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1787790669.370552:0:8637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979648:0@lo:5: 00000100:00100000:1.0:1787790669.370641:0:8637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790669.372842:0:8637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8090240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790669.373340:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979648 00000100:00100000:2.0:1787790669.373351:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979648 00000100:00100000:2.0:1787790669.373403:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790669.373413:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8637:x1874634267979648:12345-0@lo:5: 00002000:00080000:1.0:1787790669.390152:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787790669.390181:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1787790669.397330:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8637:x1874634267979648:12345-0@lo:5: Request processed in 23911us (26681us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787790669.397343:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787790669.401023:0:8637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe64780 x1874634267979648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790669.401051:0:8637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8637:1874634267979648:0@lo:5: 00000004:00080000:3.0:1787790669.401072:0:8637:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1787790669.646342:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790670.667817:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790670.668657:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790670.668687:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267979776:0@lo:41: 00000100:00100000:1.0:1787790670.668799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790670.668855:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979776 00000100:00100000:2.0:1787790670.668864:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979776 00000100:00100000:1.0:1787790670.668865:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790670.668876:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267979904:0@lo:41: 00000100:00100000:1.0:1787790670.668906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790670.671018:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267979904 00000100:00100000:2.0:1787790670.671034:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267979904 00000100:00100000:2.0:1787790670.671095:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790670.671107:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267979776:12345-0@lo:41: 00000004:00000024:2.0:1787790670.671153:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787790670.671267:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267979776:12345-0@lo:41: Request processed in 162us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790670.671289:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790670.671524:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787790670.671533:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267979904:12345-0@lo:41: 00000004:00000024:2.0:1787790670.671553:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787790670.671598:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267979904:12345-0@lo:41: Request processed in 67us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790670.671604:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787790670.671676:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267979904:0@lo:41: 00000100:00100000:0.0:1787790670.674578:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267979776:0@lo:41: 00000001:02000400:1.0:1787790671.275296:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787790671.693061:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787790671.985036:0:8854:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790671.985235:0:8854:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787790672.716035:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787790672.737106:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1787790673.738895:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787790674.492300:0:8955:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790674.492607:0:8955:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787790674.763995:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267980032:0@lo:400: 00000100:00100000:1.0:1787790674.764067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764113:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634267980544:0@lo:400: 00000100:00100000:1.0:1787790674.764136:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764153:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634267981056:0@lo:400: 00000100:00100000:1.0:1787790674.764171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764189:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787790674.764194:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267980416:0@lo:400: 00000100:00100000:1.0:1787790674.764211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764225:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267980928:0@lo:400: 00000100:00100000:1.0:1787790674.764248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764273:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634267980160:0@lo:400: 00000100:00100000:1.0:1787790674.764292:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764306:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634267980672:0@lo:400: 00000100:00100000:1.0:1787790674.764320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764332:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267981184:0@lo:13: 00000100:00100000:1.0:1787790674.764348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764361:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787790674.764366:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267980288:0@lo:400: 00000100:00100000:1.0:1787790674.764381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764394:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634267980800:0@lo:400: 00000100:00100000:1.0:1787790674.764412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790674.764433:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980032 00000100:00100000:1.0:1787790674.764439:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980032 00000100:00100000:1.0:1787790674.764481:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787790674.764488:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:3639:x1874634267980032:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764529:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:3639:x1874634267980032:12345-0@lo:400: Request processed in 41us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787790674.764563:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980544 00000100:00100000:1.0:1787790674.764566:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980544 00000100:00100000:1.0:1787790674.764581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980160 00000100:00100000:1.0:1787790674.764583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980160 00000100:00100000:1.0:1787790674.764592:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980672 00000100:00100000:1.0:1787790674.764594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980672 00000100:00100000:1.0:1787790674.764612:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980800 00000100:00100000:1.0:1787790674.764614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980800 00000100:00100000:1.0:1787790674.764634:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790674.764639:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634267980544:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634267980544:12345-0@lo:400: Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764670:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787790674.764692:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787790674.764698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634267980160:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764745:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634267980160:12345-0@lo:400: Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764751:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787790674.764761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790674.764766:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634267980672:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764787:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634267980672:12345-0@lo:400: Request processed in 21us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764792:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790674.764800:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787790674.764805:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634267980800:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764824:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634267980800:12345-0@lo:400: Request processed in 19us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764829:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787790674.764842:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981056 00000100:00100000:1.0:1787790674.764845:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981056 00000100:00100000:1.0:1787790674.764864:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980928 00000100:00100000:1.0:1787790674.764866:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980928 00000100:00100000:1.0:1787790674.764878:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790674.764883:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634267981056:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764907:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634267981056:12345-0@lo:400: Request processed in 23us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764917:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790674.764927:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790674.764932:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267980928:12345-0@lo:400: 00000100:00100000:1.0:1787790674.764955:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267980928:12345-0@lo:400: Request processed in 24us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.764960:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790674.765367:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980416 00000100:00100000:1.0:1787790674.765372:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980416 00000100:00100000:1.0:1787790674.765433:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267980288 00000100:00100000:1.0:1787790674.765436:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267980288 00000100:00100000:3.0:1787790674.765463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790674.765471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267980416:12345-0@lo:400: 00000100:00100000:3.0:1787790674.765510:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267980416:12345-0@lo:400: Request processed in 40us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790674.765515:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790674.765527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787790674.765532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267980288:12345-0@lo:400: 00000100:00100000:3.0:1787790674.765552:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267980288:12345-0@lo:400: Request processed in 20us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790674.765557:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790674.765664:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981184 00000100:00100000:1.0:1787790674.765668:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981184 00000100:00100000:1.0:1787790674.765765:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790674.765772:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267981184:12345-0@lo:13: 00002000:00000024:1.0:1787790674.765792:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790674.765820:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267981184:12345-0@lo:13: Request processed in 50us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790674.765825:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790674.765911:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267980416:0@lo:400: 00010000:00080000:1.0:1787790674.765926:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe8ad00 x1874634267980928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.765936:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787790674.765949:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267980928:0@lo:400: 00000100:00100000:1.0:1787790674.765958:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267980032:0@lo:400: 00010000:00080000:1.0:1787790674.765968:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe8a940 x1874634267980544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.765984:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634267980544:0@lo:400: 00010000:00080000:1.0:1787790674.765996:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe88f00 x1874634267981056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.766003:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787790674.766011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634267981056:0@lo:400: 00000100:00080000:1.0:1787790674.766040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790674.766045:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790674.766047:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790674.766059:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267980288:0@lo:400: 00010000:00080000:1.0:1787790674.766070:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe892c0 x1874634267980800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.766078:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634267980800:0@lo:400: 00010000:00080000:1.0:1787790674.766088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe65a40 x1874634267980160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.766096:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634267980160:0@lo:400: 00010000:00080000:1.0:1787790674.766104:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe8b480 x1874634267980672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.766112:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634267980672:0@lo:400: 00010000:00080000:1.0:1787790674.766119:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe8bc00 x1874634267981184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.766130:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267981184:0@lo:13: 00000100:00100000:1.0:1787790674.766144:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790674.766156:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4e230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267981312:0@lo:13: 00000100:00100000:1.0:1787790674.766182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790674.766269:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981312 00000100:00100000:3.0:1787790674.766272:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981312 00000100:00100000:3.0:1787790674.766321:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790674.766328:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267981312:12345-0@lo:13: 00002000:00000024:3.0:1787790674.766338:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790674.766366:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267981312:12345-0@lo:13: Request processed in 39us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790674.766371:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790674.766411:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4e230c0 x1874634267981312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790674.766422:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4e230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267981312:0@lo:13: 00010000:00010000:3.0:1787790674.770472:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787790675.192653:0:9003:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790675.192663:0:9003:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787790675.787572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267981440:0@lo:41: 00000100:00100000:1.0:1787790675.787641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790675.787724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981440 00000100:00100000:1.0:1787790675.787730:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981440 00000100:00100000:1.0:1787790675.787772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790675.787782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267981440:12345-0@lo:41: 00000004:00000024:1.0:1787790675.787823:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787790675.787878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267981440:12345-0@lo:41: Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790675.787885:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790675.787929:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267981440:0@lo:41: 00010000:00010000:3.0:1787790675.790628:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790675.790639:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790675.790656:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4e22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267981568:0@lo:41: 00000100:00100000:3.0:1787790675.790748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790675.790791:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981568 00000100:00100000:3.0:1787790675.790797:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981568 00000100:00100000:2.0:1787790675.791018:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787790675.791027:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267981568:12345-0@lo:41: 00000004:00000024:2.0:1787790675.791059:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787790675.791103:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267981568:12345-0@lo:41: Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790675.791110:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790675.791195:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4e22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267981568:0@lo:41: 00010000:00010000:1.0:1787790676.810924:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790677.834914:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790678.858946:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790679.882883:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267981696:0@lo:13: 00000100:00100000:1.0:1787790679.882955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.883025:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981696 00000100:00100000:1.0:1787790679.883032:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981696 00000100:00100000:1.0:1787790679.883087:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790679.883096:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267981696:12345-0@lo:13: 00002000:00000024:1.0:1787790679.883126:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790679.883180:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267981696:12345-0@lo:13: Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.883187:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787790679.883211:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790679.883430:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634267981952:0@lo:400: 00000100:00100000:1.0:1787790679.883474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.883497:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634267982464:0@lo:400: 00000100:00100000:1.0:1787790679.883520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.883540:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787790679.883545:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267982080:0@lo:400: 00000100:00100000:1.0:1787790679.883567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.883591:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634267982592:0@lo:400: 00000100:00100000:1.0:1787790679.883608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.883648:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981952 00000100:00100000:1.0:1787790679.883652:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981952 00000100:00100000:1.0:1787790679.883674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982464 00000100:00100000:1.0:1787790679.883676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982464 00000100:00100000:1.0:1787790679.883694:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982592 00000100:00100000:1.0:1787790679.883696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982592 00000100:00100000:1.0:1787790679.883735:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790679.883742:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634267981952:12345-0@lo:400: 00000100:00100000:1.0:1787790679.883782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634267981952:12345-0@lo:400: Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.883788:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790679.883801:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790679.883807:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634267982464:12345-0@lo:400: 00000100:00100000:1.0:1787790679.883834:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634267982464:12345-0@lo:400: Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.883846:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790679.883858:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790679.883864:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634267982592:12345-0@lo:400: 00000100:00100000:1.0:1787790679.883904:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634267982592:12345-0@lo:400: Request processed in 39us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.883910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790679.883931:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982080 00000100:00100000:1.0:1787790679.883934:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982080 00000100:00100000:1.0:1787790679.883960:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790679.883966:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267982080:12345-0@lo:400: 00000100:00100000:1.0:1787790679.883997:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267982080:12345-0@lo:400: Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.884003:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790679.884026:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267981824:0@lo:400: 00000100:00100000:1.0:1787790679.884056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.884079:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267982336:0@lo:400: 00000100:00100000:1.0:1787790679.884100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.884118:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787790679.884124:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267982208:0@lo:400: 00000100:00100000:1.0:1787790679.884144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.884162:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267982720:0@lo:400: 00000100:00100000:1.0:1787790679.884183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790679.884208:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267981824 00000100:00100000:1.0:1787790679.884212:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267981824 00000100:00100000:1.0:1787790679.884239:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787790679.884246:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:3641:x1874634267981824:12345-0@lo:400: 00000100:00100000:1.0:1787790679.884286:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:3641:x1874634267981824:12345-0@lo:400: Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.884293:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787790679.884318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982208 00000100:00100000:1.0:1787790679.884322:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982208 00000100:00100000:1.0:1787790679.884342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790679.884348:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267982208:12345-0@lo:400: 00000100:00100000:1.0:1787790679.884378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267982208:12345-0@lo:400: Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.884383:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790679.884399:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982720 00000100:00100000:1.0:1787790679.884402:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982720 00000100:00100000:1.0:1787790679.884426:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790679.884432:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267982720:12345-0@lo:400: 00000100:00100000:1.0:1787790679.884460:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267982720:12345-0@lo:400: Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.884466:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787790679.884488:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790679.884492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790679.884495:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787790679.884527:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe8a580 x1874634267981696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790679.884546:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267981696:0@lo:13: 00000100:00100000:1.0:1787790679.884576:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267982208:0@lo:400: 00010000:00080000:1.0:1787790679.884586:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe64780 x1874634267982720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790679.884608:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267982720:0@lo:400: 00000100:00100000:1.0:1787790679.884620:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267981824:0@lo:400: 00000100:00100000:1.0:1787790679.884660:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267982080:0@lo:400: 00010000:00080000:1.0:1787790679.884670:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe64b40 x1874634267982592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790679.884679:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634267982592:0@lo:400: 00010000:00080000:1.0:1787790679.884688:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe8a940 x1874634267981952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790679.884696:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634267981952:0@lo:400: 00010000:00080000:1.0:1787790679.884726:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe661c0 x1874634267982464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790679.884736:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634267982464:0@lo:400: 00000100:00100000:1.0:1787790679.884757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982336 00000100:00100000:1.0:1787790679.884761:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982336 00000100:00100000:1.0:1787790679.884784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790679.884791:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267982336:12345-0@lo:400: 00000100:00100000:1.0:1787790679.884825:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267982336:12345-0@lo:400: Request processed in 34us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790679.884831:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787790679.884857:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe65a40 x1874634267982336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790679.884865:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267982336:0@lo:400: 00000100:00100000:2.0:1787790679.885319:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4e22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267982848:0@lo:13: 00000100:00100000:2.0:1787790679.885358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790679.885426:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982848 00000100:00100000:3.0:1787790679.885430:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982848 00000100:00100000:3.0:1787790679.885464:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790679.885472:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267982848:12345-0@lo:13: 00002000:00000024:3.0:1787790679.885485:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790679.885524:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267982848:12345-0@lo:13: Request processed in 53us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790679.885530:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787790679.885557:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4e22d00 x1874634267982848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790679.885570:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4e22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267982848:0@lo:13: 00010000:00010000:1.0:1787790679.888879:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790680.907019:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4e22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267982976:0@lo:41: 00000100:00100000:1.0:1787790680.907106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790680.907218:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790680.907225:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267983104:0@lo:41: 00000100:00100000:1.0:1787790680.907250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790680.907746:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267982976 00000100:00100000:3.0:1787790680.907755:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267982976 00000100:00100000:3.0:1787790680.907813:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983104 00000100:00100000:3.0:1787790680.907816:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983104 00000100:00100000:3.0:1787790680.908006:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790680.908022:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267982976:12345-0@lo:41: 00000004:00000024:3.0:1787790680.908069:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787790680.908138:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267982976:12345-0@lo:41: Request processed in 120us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790680.908145:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790680.908164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790680.908171:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267983104:12345-0@lo:41: 00000004:00000024:3.0:1787790680.908188:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787790680.908215:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267983104:12345-0@lo:41: Request processed in 44us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790680.908229:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1787790680.908468:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790680.908507:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267983104:0@lo:41: 00000100:00100000:1.0:1787790680.908650:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4e22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267982976:0@lo:41: 00010000:00010000:1.0:1787790681.932496:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790682.955838:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787790683.454212:0:9502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790683.454216:0:9502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787790683.454218:0:9502:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787790683.454381:0:9502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170f67a4800 00000020:01000004:2.0:1787790683.454401:0:9502:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787790683.454420:0:9502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787790683.454437:0:9502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9170fbeecd28) 00000020:00000080:2.0:1787790683.454458:0:9502:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787790683.507063:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787790683.507160:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1787790683.530472:0:9502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787790683.531154:0:9502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787790683.531168:0:9502:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790683.531179:0:9502:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf9477fddcf1d87c 00000020:01000004:2.0:1787790683.531186:0:9502:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787790683.531206:0:9502:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787790683.531209:0:9502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787790683.531216:0:9502:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787790683.531243:0:9502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787790683.531248:0:9502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787790683.567693:0:9502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787790683.568064:0:9502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787790683.568067:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787790683.568069:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787790683.568070:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790683.568072:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790683.568073:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790683.568074:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790683.568075:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790683.568077:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787790683.568078:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787790683.568080:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790683.568082:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787790683.568085:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787790683.568087:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787790683.568088:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787790683.568089:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790683.568090:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790683.568091:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790683.568092:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790683.568093:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790683.568094:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787790683.568095:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787790683.568096:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790683.568097:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787790683.568125:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787790683.568141:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267983232:0@lo:253: 00000100:00100000:2.0:1787790683.568215:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.568272:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790683.568465:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983232 00000100:00100000:1.0:1787790683.568472:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983232 00000100:00100000:1.0:1787790683.568519:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787790683.568528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:9502:x1874634267983232:12345-0@lo:253: 20000000:01000000:1.0:1787790683.568575:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787790683.568578:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787790683.568582:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787790683.568585:0:6505:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787790683.568994:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790683.569119:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787790683.569134:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787790683.569151:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787790683.569158:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787790683.569171:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787790683.569187:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787790683.569265:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787790683.569278:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.122@tcp 20000000:01000000:1.0:1787790683.569285:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790683.569299:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787790683.569305:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790683.569317:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787790683.569323:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790683.569334:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787790683.569340:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787790683.569353:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787790683.569367:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787790683.569515:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787790683.569527:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.122@tcp 20000000:01000000:1.0:1787790683.569529:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790683.569621:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787790683.569629:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787790683.569646:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787790683.569651:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790683.569664:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787790683.569670:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787790683.569681:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787790683.569694:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1787790683.570153:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1787790683.570166:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.122@tcp 20000000:01000000:1.0:1787790683.570168:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.122@tcp (null) (null) (null) 00000040:00080000:1.0:1787790683.570183:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1787790683.570188:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787790683.570204:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1787790683.570209:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.122@tcp (null) (null) 00000040:00080000:1.0:1787790683.570222:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1787790683.570228:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787790683.570259:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1787790683.570287:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1787790683.570302:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787790683.570305:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787790683.570308:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787790683.570358:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787790683.570360:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790683.570812:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790683.570844:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790683.570854:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787790683.570964:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787790683.570984:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1787790683.570999:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1787790683.571007:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787790683.571008:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787790683.571204:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1787790683.571282:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1787790683.571300:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1787790683.571313:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1787790683.571322:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787790683.571323:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790683.571639:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790683.571653:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790683.571661:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787790683.571857:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787790683.571876:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787790683.571890:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787790683.571897:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787790683.571899:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790683.572087:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790683.572116:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790683.572132:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1787790683.572212:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1787790683.572232:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1787790683.572246:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1787790683.572253:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787790683.572254:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787790683.572498:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787790683.572510:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787790683.572518:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1787790683.572660:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1787790683.572680:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1787790683.572734:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1787790683.572819:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787790683.572838:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572852:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572857:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572862:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572866:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572878:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572882:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572887:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572894:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572933:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.572948:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.572963:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983360:0@lo:104: 00000100:00100000:2.0:1787790683.573026:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790683.573074:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.573082:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983360 00010000:00010000:2.0:1787790683.573083:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 21 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.573092:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983488:0@lo:104: 00000100:00100000:0.0:1787790683.573096:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983360 00000100:00100000:2.0:1787790683.573117:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790683.573146:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.573157:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.573163:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983616:0@lo:104: 00000100:00100000:2.0:1787790683.573177:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.573296:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983488 00000100:00100000:0.0:1787790683.573301:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983488 00010000:00010000:2.0:1787790683.573302:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.573310:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 21 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.573317:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983744:0@lo:104: 00000100:00100000:0.0:1787790683.573324:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983616 00000100:00100000:0.0:1787790683.573328:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983616 00000100:00100000:2.0:1787790683.573334:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.573345:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983744 00000100:00100000:0.0:1787790683.573349:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983744 00010000:00010000:2.0:1787790683.573351:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.573357:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.573363:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983872:0@lo:104: 00000100:00100000:0.0:1787790683.573372:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790683.573378:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.573469:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787790683.573478:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787790683.573688:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.573690:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+6:6505:x1874634267983360:12345-0@lo:104: 00010000:00010000:2.0:1787790683.573723:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.573735:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267984000:0@lo:104: 00010000:00010000:0.0:1787790683.573740:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.573794:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790683.573815:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787790683.573821:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.573825:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+6:6505:x1874634267983360:12345-0@lo:104: Request processed in 442us (797us total) trans 0 rc 0/0 00010000:00010000:2.0:1787790683.573840:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.573844:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790683.573855:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267983872 00000100:00100000:2.0:1787790683.573855:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267984128:0@lo:104: 00000100:00100000:3.0:1787790683.573860:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267983872 00000100:00100000:0.0:1787790683.573876:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787790683.573883:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c4ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790683.573885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984000 00000100:00100000:3.0:1787790683.573888:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984000 00000100:00100000:0.0:1787790683.573900:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.573907:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790683.573914:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787790683.573918:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+7:6505:x1874634267983488:12345-0@lo:104: 00000100:00100000:0.0:1787790683.573923:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984128 00000100:00100000:0.0:1787790683.573928:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984128 00010000:00010000:3.0:1787790683.573929:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.573978:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787790683.573984:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+8:6505:x1874634267983488:12345-0@lo:104: Request processed in 70us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.573991:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787790683.573998:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787790683.574007:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787790683.574008:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574016:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+7:6505:x1874634267983616:12345-0@lo:104: 00010000:00010000:3.0:1787790683.574024:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574043:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.574050:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574060:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574063:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1787790683.574072:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574073:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+7:6505:x1874634267983616:12345-0@lo:104: Request processed in 59us (893us total) trans 0 rc 0/0 10000000:01000000:1.0:1787790683.574087:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787790683.574088:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787790683.574106:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790683.574113:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+6:6505:x1874634267983744:12345-0@lo:104: 00010000:00010000:3.0:1787790683.574121:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574125:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574133:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790683.574155:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574164:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1d867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d86e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574167:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787790683.574176:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+6:6505:x1874634267983744:12345-0@lo:104: Request processed in 63us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.574183:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787790683.574185:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787790683.574189:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574197:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787790683.574197:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031800 already unused, calling callback (ffffffffc11c1c20) 00000100:00100000:2.0:1787790683.574199:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983360:0@lo:104: 10000000:00010000:1.0:1787790683.574204:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574205:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:6505:x1874634267983872:12345-0@lo:104: 00000100:00100000:2.0:1787790683.574210:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983488:0@lo:104: 00010000:00010000:3.0:1787790683.574216:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.574222:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983616:0@lo:104: 00000100:00100000:2.0:1787790683.574229:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983744:0@lo:104: 00010000:00010000:1.0:1787790683.574243:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574246:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787790683.574255:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:6505:x1874634267983872:12345-0@lo:104: Request processed in 51us (876us total) trans 0 rc 0/0 10000000:00010000:1.0:1787790683.574258:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 10000000:01000000:1.0:1787790683.574272:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787790683.574283:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787790683.574291:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f675e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6505:x1874634267984000:12345-0@lo:104: 00010000:00010000:1.0:1787790683.574294:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574299:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574303:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790683.574312:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574321:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0031800/0xcf9477fddcf1d83d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d844 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574331:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1787790683.574334:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1787790683.574340:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f675e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:6505:x1874634267984000:12345-0@lo:104: Request processed in 48us (544us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790683.574341:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574353:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787790683.574355:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.574360:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.574368:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790683.574376:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574387:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787790683.574394:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:6505:x1874634267984128:12345-0@lo:104: 00010000:00010000:3.0:1787790683.574401:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574432:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787790683.574436:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:6505:x1874634267984128:12345-0@lo:104: Request processed in 44us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.574441:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787790683.574468:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267984384:0@lo:103: 00000100:00100000:3.0:1787790683.574493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.574516:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790683.574521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267984256:0@lo:103: 00000100:00100000:3.0:1787790683.574539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.574563:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984384 00000100:00100000:3.0:1787790683.574566:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984384 00010000:00010000:3.0:1787790683.574595:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 22 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574624:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984256 00000100:00100000:3.0:1787790683.574627:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984256 00010000:00010000:3.0:1787790683.574638:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 23 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.574656:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790683.574662:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+23:3641:x1874634267984384:12345-0@lo:103: 00010000:00010000:3.0:1787790683.574670:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790683.574674:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 23 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574683:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 23 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574735:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1d844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d83d expref: 23 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574760:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790683.574767:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1787790683.574794:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+22:3641:x1874634267984384:12345-0@lo:103: Request processed in 131us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.574801:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790683.574816:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790683.574821:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+21:3641:x1874634267984256:12345-0@lo:103: 00010000:00010000:3.0:1787790683.574828:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790683.574834:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574842:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574852:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031200/0xcf9477fddcf1d86e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d867 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.574860:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790683.574883:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+20:3641:x1874634267984256:12345-0@lo:103: Request processed in 61us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.574889:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790683.574929:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267984256:0@lo:103: 00000100:00100000:3.0:1787790683.574938:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267984384:0@lo:103: 10000000:01000000:1.0:1787790683.575002:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787790683.575009:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267983872:0@lo:104: 00000100:00100000:2.0:1787790683.575026:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267984000:0@lo:104: 00010000:00010000:1.0:1787790683.575031:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.575035:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1874634267984128:0@lo:104: 00010000:00010000:1.0:1787790683.575044:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790683.575063:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575069:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1d821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d828 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575080:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787790683.575084:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.575086:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575098:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.575103:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575111:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790683.575117:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790683.575121:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790683.575134:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575139:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790683.575151:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575158:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030e00/0xcf9477fddcf1d7db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575168:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790683.575171:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575177:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e0400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.575180:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575186:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790683.575191:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790683.575197:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790683.575209:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575214:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790683.575230:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575237:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7a3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575247:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790683.575255:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575261:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.575264:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575270:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790683.575276:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790683.575282:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790683.575298:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575305:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790683.575311:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575316:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1400/0xcf9477fddcf1d772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d779 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.575325:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790683.575327:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790683.575329:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790683.575343:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267984768:0@lo:103: 00000100:00100000:2.0:1787790683.575381:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267984896:0@lo:103: 00000100:00100000:1.0:1787790683.575382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.575675:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984768 00000100:00100000:3.0:1787790683.575681:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984768 00010000:00010000:3.0:1787790683.575738:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 20 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.575820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.575869:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267984512:0@lo:103: 00000100:00100000:3.0:1787790683.575901:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984896 00000100:00100000:3.0:1787790683.575906:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984896 00010000:00010000:3.0:1787790683.575923:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.575954:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790683.575965:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+21:3640:x1874634267984768:12345-0@lo:103: 00010000:00010000:0.0:1787790683.575976:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790683.575981:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.575992:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790683.575996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790683.576026:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d79c expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576039:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790683.576063:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790683.576071:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267984640:0@lo:103: 00000100:00100000:0.0:1787790683.576080:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+20:3640:x1874634267984768:12345-0@lo:103: Request processed in 117us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.576089:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790683.576101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.576107:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984512 00000100:00100000:0.0:1787790683.576111:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984512 00010000:00010000:0.0:1787790683.576126:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 20 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.576139:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267984640 00000100:00100000:1.0:1787790683.576142:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267984768:0@lo:103: 00000100:00100000:0.0:1787790683.576142:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267984640 00010000:00010000:0.0:1787790683.576154:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 21 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.576169:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790683.576176:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4788c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+21:3641:x1874634267984896:12345-0@lo:103: 00010000:00010000:0.0:1787790683.576185:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790683.576190:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576198:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576208:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1d779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d772 expref: 21 pid: 6506 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.576222:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790683.576227:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790683.576268:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4788c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+20:3641:x1874634267984896:12345-0@lo:103: Request processed in 93us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.576274:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787790683.576280:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.576290:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.576294:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.576302:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790683.576310:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790683.576315:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787790683.576321:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790683.576328:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+19:3638:x1874634267984512:12345-0@lo:103: 00010000:00010000:0.0:1787790683.576336:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790683.576341:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 19 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.576344:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576353:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 19 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.576355:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790683.576368:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d821 expref: 19 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.576370:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576384:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790683.576399:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1d7f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.576408:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+18:3638:x1874634267984512:12345-0@lo:103: Request processed in 81us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.576421:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787790683.576438:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790683.576439:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787790683.576443:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790683.576449:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790683.576452:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+17:3638:x1874634267984640:12345-0@lo:103: 00010000:00010000:0.0:1787790683.576461:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787790683.576465:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267985024:0@lo:103: 00010000:00010000:0.0:1787790683.576467:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 17 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576479:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 17 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576498:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1d7e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d7db expref: 17 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790683.576501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790683.576514:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790683.576525:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267984512:0@lo:103: 00000100:00100000:0.0:1787790683.576543:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+16:3638:x1874634267984640:12345-0@lo:103: Request processed in 95us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.576550:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790683.576558:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267984640:0@lo:103: 00000100:00100000:0.0:1787790683.576565:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985024 00000100:00100000:0.0:1787790683.576570:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985024 00010000:00010000:1.0:1787790683.576577:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790683.576580:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790683.576607:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 16 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.576622:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790683.576628:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+16:3638:x1874634267985024:12345-0@lo:103: 00010000:00010000:0.0:1787790683.576634:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790683.576638:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 16 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576646:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 16 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576655:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9fa00/0xcf9477fddcf1d7fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d7f7 expref: 16 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576665:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576673:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576695:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576702:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576729:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576735:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790683.576770:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634267984896:0@lo:103: 00010000:00010000:0.0:1787790683.576932:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790683.576939:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576948:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576964:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.576976:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790683.576987:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.576997:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.577015:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38800/0xcf9477fddcf1d883 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.577016:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+15:3638:x1874634267985024:12345-0@lo:103: Request processed in 387us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.577032:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:2.0:1787790683.577039:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787790683.577094:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267985024:0@lo:103: 00000100:00100000:2.0:1787790683.579759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+14:9502:x1874634267983232:12345-0@lo:253: Request processed in 11221us (11533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.579777:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787790683.579966:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267983232:0@lo:253: 10000000:01000000:1.0:1787790683.579982:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787790683.579986:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790683.579987:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787790683.579989:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790683.579990:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787790683.579991:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790683.579993:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790683.579994:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790683.579996:0:9502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787790683.579997:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790683.579999:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790683.580024:0:9502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170f67a4800 from lustre-OST0001 10000000:01000000:1.0:1787790683.580056:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787790683.580060:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787790683.580068:0:9502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9170d6383370 local copy 10000000:01000000:1.0:1787790683.580082:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787790683.580119:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.580130:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.580139:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790683.580157:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985152:0@lo:101: 00000100:00100000:1.0:1787790683.580194:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.580266:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc107c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.580304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985152 00000100:00100000:2.0:1787790683.580310:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985152 00000100:00100000:2.0:1787790683.580385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787790683.580396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:9502:x1874634267985152:12345-0@lo:101: 00010000:00010000:2.0:1787790683.580408:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790683.580422:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1d891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d88a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.580446:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1d891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d88a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.580457:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1d891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d88a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.580466:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38c00, rc 0) 00000100:00100000:2.0:1787790683.580505:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985152:12345-0@lo:101: Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.580512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787790683.580536:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985152:0@lo:101: 00010000:00010000:3.0:1787790683.580551:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.580560:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.580681:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985280:0@lo:501: 00000100:00100000:3.0:1787790683.580737:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.581961:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790683.581976:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985280 00000100:00100000:1.0:1787790683.581983:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985280 00000100:00100000:0.0:1787790683.582109:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787790683.582119:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985280:12345-0@lo:501: 00000100:00100000:0.0:1787790683.582210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985280:12345-0@lo:501: Request processed in 93us (1472us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790683.582226:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787790683.582306:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985280:0@lo:501: 10000000:01000000:3.0:1787790683.582321:0:9502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787790683.582339:0:9502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787790683.582346:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.582355:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.582361:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.582391:0:9502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787790683.582418:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170f67a4800 10000000:01000000:3.0:1787790683.582422:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787790683.582425:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787790683.582428:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787790683.582431:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787790683.582434:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790683.582436:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787790683.582441:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787790683.582450:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790683.582455:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.582464:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.582473:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.582475:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.582484:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790683.582486:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790683.582498:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787790683.582504:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985408:0@lo:101: 00010000:00010000:1.0:1787790683.582523:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.582535:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790683.582552:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787790683.582555:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6eb40 going to sleep for 11 seconds 00010000:00010000:1.0:1787790683.582581:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.582590:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1e00/0xcf9477fddcf1d88a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf9477fddcf1d891 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.582614:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790683.582617:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790683.582620:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267985536:0@lo:103: 00010000:00010000:1.0:1787790683.582621:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790683.582647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.582751:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985536 00000100:00100000:1.0:1787790683.582756:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985536 00000100:00100000:1.0:1787790683.582792:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790683.582800:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+15:3639:x1874634267985536:12345-0@lo:103: 00010000:00010000:1.0:1787790683.582810:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790683.582824:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1d891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d88a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.582839:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790683.582882:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+14:3639:x1874634267985536:12345-0@lo:103: Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.582890:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790683.582903:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634267985536:0@lo:103: 00000100:00100000:2.0:1787790683.583027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985408 00000100:00100000:2.0:1787790683.583032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985408 00000100:00100000:2.0:1787790683.583061:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787790683.583078:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+14:9502:x1874634267985408:12345-0@lo:101: 00010000:00010000:2.0:1787790683.583087:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790683.583098:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d898 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.583116:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.583127:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.583133:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39800, rc 0) 00000100:00100000:2.0:1787790683.583172:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985408:12345-0@lo:101: Request processed in 98us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.583178:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787790683.583203:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985408:0@lo:101: 00010000:00010000:3.0:1787790683.583216:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.583226:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.583286:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985664:0@lo:501: 00000100:00100000:3.0:1787790683.583319:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.583347:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.583391:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985664 00000100:00100000:0.0:1787790683.583395:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985664 00000100:00100000:0.0:1787790683.583420:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787790683.583427:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985664:12345-0@lo:501: 00000100:00100000:0.0:1787790683.583551:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985664:12345-0@lo:501: Request processed in 125us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.583558:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787790683.583672:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985664:0@lo:501: 00000100:00100000:3.0:1787790683.583697:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985792:0@lo:503: 00000100:00100000:2.0:1787790683.583973:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.584002:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790683.584047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985792 00000100:00100000:1.0:1787790683.584051:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985792 00000100:00100000:1.0:1787790683.584229:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787790683.584239:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985792:12345-0@lo:503: 00000100:00100000:1.0:1787790683.584330:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985792:12345-0@lo:503: Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.584347:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787790683.584351:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985792:0@lo:503: 00000040:00080000:3.0:1787790683.584663:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790683.584750:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985920:0@lo:502: 00000100:00100000:0.0:1787790683.584927:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.584986:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.585024:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267985920 00000100:00100000:2.0:1787790683.585028:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267985920 00000100:00100000:2.0:1787790683.585094:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787790683.585102:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985920:12345-0@lo:502: 00000100:00100000:2.0:1787790683.585845:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267985920:12345-0@lo:502: Request processed in 741us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.585854:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787790683.585881:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267985920:0@lo:502: 00000040:00080000:1.0:1787790683.586139:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787790683.586171:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787790683.586187:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787790683.586202:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787790683.586231:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787790683.586247:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787790683.586275:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986048:0@lo:502: 00000100:00100000:1.0:1787790683.586314:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.586352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986048 00000100:00100000:1.0:1787790683.586354:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc107f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.586359:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986048 00000100:00100000:0.0:1787790683.586392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787790683.586399:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267986048:12345-0@lo:502: 00000100:00100000:0.0:1787790683.586468:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267986048:12345-0@lo:502: Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.586474:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787790683.586655:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986048:0@lo:502: 00000040:00080000:1.0:1787790683.586693:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787790683.586702:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1787790683.587477:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787790683.587486:0:9515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787790683.587493:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790683.587495:0:9515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787790683.587501:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790683.587524:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff916fc320b370) 00000020:00000080:1.0:1787790683.587547:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787790683.587554:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787790683.587637:0:9515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f67a4800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787790683.587646:0:9515:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787790683.587653:0:9515:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf9477fddcf1d8ad 00010000:00010000:0.0:1787790683.596358:0:9515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787790683.596895:0:9515:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787790683.603247:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787790683.605178:0:9515:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787790683.613062:0:9515:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787790683.613259:0:9515:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787790683.621297:0:9515:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787790683.623067:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787790683.623078:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790683.623085:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790683.623093:0:9515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787790683.623097:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790683.623100:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790683.623102:0:9515:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787790683.623105:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787790683.623107:0:9515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787790683.623128:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790683.623130:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790683.623131:0:9515:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787790683.623134:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787790683.623334:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787790683.623367:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787790683.623391:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623426:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790683.623434:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f67a4800 from 1 10000000:01000000:2.0:1787790683.623437:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790683.623474:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623482:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623493:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.623514:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986176:0@lo:101: 00000100:00100000:2.0:1787790683.623577:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.623624:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.623644:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986176 00000100:00100000:2.0:1787790683.623650:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986176 00000100:00100000:2.0:1787790683.623697:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787790683.623749:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+15:9502:x1874634267986176:12345-0@lo:101: 00010000:00010000:2.0:1787790683.623761:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790683.623773:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d8b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623796:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623807:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623821:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38200, rc 0) 00000100:00100000:2.0:1787790683.623855:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986176:12345-0@lo:101: Request processed in 150us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.623862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787790683.623928:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986176:0@lo:101: 00010000:00010000:2.0:1787790683.623943:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.623952:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.624041:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986304:0@lo:501: 00000100:00100000:2.0:1787790683.624064:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.624082:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.624095:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986304 00000100:00100000:2.0:1787790683.624098:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986304 00000100:00100000:2.0:1787790683.624118:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787790683.624123:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986304:12345-0@lo:501: 00000100:00100000:2.0:1787790683.624205:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986304:12345-0@lo:501: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.624211:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787790683.624232:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986304:0@lo:501: 00000100:00100000:2.0:1787790683.624256:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986432:0@lo:503: 00000100:00100000:2.0:1787790683.624292:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.624300:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.624318:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986432 00000100:00100000:2.0:1787790683.624321:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986432 00000100:00100000:2.0:1787790683.624338:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787790683.624344:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986432:12345-0@lo:503: 00000100:00100000:2.0:1787790683.624416:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986432:12345-0@lo:503: Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.624422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787790683.624456:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986432:0@lo:503: 00000040:00080000:2.0:1787790683.624680:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787790683.624773:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986560:0@lo:502: 00000100:00100000:2.0:1787790683.624802:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.624820:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.624831:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986560 00000100:00100000:2.0:1787790683.624834:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986560 00000100:00100000:2.0:1787790683.624848:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787790683.624853:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986560:12345-0@lo:502: 00000100:00100000:2.0:1787790683.624921:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986560:12345-0@lo:502: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.624928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787790683.624965:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986560:0@lo:502: 00000040:00080000:2.0:1787790683.625143:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787790683.625167:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787790683.625187:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986688:0@lo:502: 00000100:00100000:2.0:1787790683.625219:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.625233:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790683.625246:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986688 00000100:00100000:2.0:1787790683.625249:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986688 00000100:00100000:2.0:1787790683.625271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787790683.625276:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986688:12345-0@lo:502: 00000100:00100000:2.0:1787790683.625336:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986688:12345-0@lo:502: Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790683.625342:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787790683.625377:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986688:0@lo:502: 00000040:00080000:2.0:1787790683.625408:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787790683.625415:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787790683.631328:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790683.631342:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790683.631345:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787790683.631352:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f67a4800 00000020:00000080:3.0:1787790683.631355:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790683.631367:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790683.631370:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790683.631371:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787790683.631374:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787790683.631576:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787790683.631629:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790683.631652:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.631666:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790683.631757:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787790683.631760:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170f67a4800 10000000:01000000:2.0:1787790683.631762:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170f67a4800 10000000:01000000:2.0:1787790683.631766:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787790683.631772:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f67a4800 from 1 10000000:01000000:2.0:1787790683.631774:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790683.631808:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.631816:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.631828:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.631863:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986816:0@lo:101: 00000100:00100000:2.0:1787790683.631933:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.631972:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.632097:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986816 00000100:00100000:0.0:1787790683.632104:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986816 00000100:00100000:0.0:1787790683.632152:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787790683.632162:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9502:x1874634267986816:12345-0@lo:101: 00010000:00010000:0.0:1787790683.632173:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790683.632184:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d8c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.632206:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.632216:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.632224:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031000, rc 0) 00000100:00100000:0.0:1787790683.632265:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267986816:12345-0@lo:101: Request processed in 105us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.632272:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787790683.632318:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986816:0@lo:101: 00010000:00010000:0.0:1787790683.632333:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790683.632342:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790683.632447:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986944:0@lo:501: 00000100:00100000:0.0:1787790683.632473:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.632490:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.632505:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267986944 00000100:00100000:0.0:1787790683.632515:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267986944 00000100:00100000:0.0:1787790683.632538:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787790683.632545:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267986944:12345-0@lo:501: 00000100:00100000:0.0:1787790683.632655:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267986944:12345-0@lo:501: Request processed in 111us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.632662:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787790683.632695:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267986944:0@lo:501: 00000100:00100000:0.0:1787790683.632751:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267987072:0@lo:503: 00000100:00100000:0.0:1787790683.632791:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.632805:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.632819:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987072 00000100:00100000:0.0:1787790683.632822:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987072 00000100:00100000:0.0:1787790683.632842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787790683.632848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267987072:12345-0@lo:503: 00000100:00100000:0.0:1787790683.632922:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267987072:12345-0@lo:503: Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.632929:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787790683.632965:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267987072:0@lo:503: 00000040:00080000:0.0:1787790683.633188:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787790683.633240:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267987200:0@lo:502: 00000100:00100000:0.0:1787790683.633275:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.633290:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.633302:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987200 00000100:00100000:0.0:1787790683.633306:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987200 00000100:00100000:0.0:1787790683.633326:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787790683.633332:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267987200:12345-0@lo:502: 00000100:00100000:0.0:1787790683.633410:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267987200:12345-0@lo:502: Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.633416:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787790683.633452:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267987200:0@lo:502: 00000040:00080000:0.0:1787790683.633649:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787790683.633673:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787790683.633686:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787790683.633699:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787790683.633735:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787790683.633760:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787790683.633774:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787790683.633787:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787790683.633800:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787790683.633813:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787790683.633824:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787790683.633834:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787790683.633845:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787790683.633856:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787790683.633869:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787790683.633881:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787790683.633895:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787790683.633909:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787790683.633922:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787790683.633935:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787790683.633948:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787790683.633971:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787790683.633987:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787790683.634002:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787790683.634015:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787790683.634030:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787790683.634042:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787790683.634065:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787790683.634079:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787790683.634092:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787790683.634104:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787790683.634117:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787790683.634131:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787790683.634145:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787790683.634158:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787790683.634170:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787790683.634182:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787790683.634206:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787790683.634221:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787790683.634232:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787790683.634245:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787790683.634258:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787790683.634271:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787790683.634283:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787790683.634295:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787790683.634309:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787790683.634334:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267987328:0@lo:502: 00000100:00100000:0.0:1787790683.634380:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790683.634403:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790683.634428:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987328 00000100:00100000:0.0:1787790683.634432:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987328 00000100:00100000:0.0:1787790683.634462:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787790683.634468:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267987328:12345-0@lo:502: 00000100:00100000:0.0:1787790683.634541:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267987328:12345-0@lo:502: Request processed in 72us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790683.634547:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787790683.634594:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267987328:0@lo:502: 00000040:00080000:0.0:1787790683.634649:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787790683.634655:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787790683.637243:0:9520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787790683.637274:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff916fc34acd28) 00000020:00000080:3.0:1787790683.637301:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787790683.637397:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f67a4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787790683.637402:0:9520:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f67a4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787790683.637404:0:9520:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67a4800 3 00010000:00080000:3.0:1787790683.637505:0:9520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc344f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790683.639954:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787790683.642549:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787790683.643036:0:9520:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787790683.643052:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf9477fddcf1d8d7 00000100:00080000:3.0:1787790683.643064:0:9520:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790683.643082:0:9520:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc344f000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790683.643121:0:9520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4f47840 x1874634267987456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790683.643152:0:9520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787790683.643264:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267987840:0@lo:400: 00000100:00100000:3.0:1787790683.643335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.643366:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267988352:0@lo:400: 00000100:00100000:3.0:1787790683.643391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.643424:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790683.643430:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267987968:0@lo:400: 00000100:00100000:3.0:1787790683.643454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.643468:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267988480:0@lo:400: 00000100:00100000:3.0:1787790683.643485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.643509:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987840 00000100:00100000:3.0:1787790683.643515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987840 00000100:00100000:3.0:1787790683.643554:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787790683.643562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267987840:12345-0@lo:400: 00000100:00100000:1.0:1787790683.643724:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634267987456:0@lo:38: 00000100:00100000:1.0:1787790683.643770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.643808:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634267987584:0@lo:400: 00000100:00100000:1.0:1787790683.643830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.643846:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634267988096:0@lo:400: 00000100:00100000:1.0:1787790683.643865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.643876:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787790683.643881:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267987712:0@lo:400: 00000100:00100000:1.0:1787790683.643903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.643920:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634267988224:0@lo:400: 00000100:00100000:1.0:1787790683.643939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.643961:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988352 00000100:00100000:1.0:1787790683.643964:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988352 00000100:00100000:1.0:1787790683.643996:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988480 00000100:00100000:1.0:1787790683.643999:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988480 00000100:00100000:1.0:1787790683.644014:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790683.644021:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267988352:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644063:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267988352:12345-0@lo:400: Request processed in 42us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644081:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790683.644099:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790683.644103:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267988480:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644129:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267988480:12345-0@lo:400: Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644134:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790683.644149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987968 00000100:00100000:1.0:1787790683.644152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987968 00000100:00100000:1.0:1787790683.644168:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987456 00000100:00100000:1.0:1787790683.644170:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987456 00000100:00100000:1.0:1787790683.644177:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987584 00000100:00100000:1.0:1787790683.644179:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987584 00000100:00100000:1.0:1787790683.644188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988096 00000100:00100000:1.0:1787790683.644190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988096 00000100:00100000:1.0:1787790683.644202:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988224 00000100:00100000:1.0:1787790683.644204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988224 00000100:00100000:1.0:1787790683.644216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790683.644221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267987968:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267987968:12345-0@lo:400: Request processed in 42us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790683.644283:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790683.644289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634267987584:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644320:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634267987584:12345-0@lo:400: Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644326:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790683.644343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790683.644350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634267988096:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644383:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634267988096:12345-0@lo:400: Request processed in 34us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790683.644401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790683.644407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634267988224:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644432:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634267988224:12345-0@lo:400: Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790683.644448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790683.644451:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634267987456:12345-0@lo:38: 00010000:00080000:1.0:1787790683.644469:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1787790683.644498:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf9477fddcf1d8de 00000004:00100000:1.0:1787790683.644512:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787790683.644539:0:6514:0:(import.c:65:import_set_state_nolock()) ffff916fc3201000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790683.644575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874634267987456:12345-0@lo:38: Request processed in 122us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790683.644627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267987712 00000100:00100000:1.0:1787790683.644630:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267987712 00000100:00100000:1.0:1787790683.644645:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787790683.644651:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267987712:12345-0@lo:400: 00000100:00100000:1.0:1787790683.644677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267987712:12345-0@lo:400: Request processed in 26us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.644682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787790683.644694:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790683.644698:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790683.644726:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790683.644756:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f46d00 x1874634267987968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644768:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267987968:0@lo:400: 00010000:00080000:1.0:1787790683.644778:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f46940 x1874634267988480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644785:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267988480:0@lo:400: 00010000:00080000:1.0:1787790683.644794:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f47c00 x1874634267988352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644801:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267988352:0@lo:400: 00010000:00080000:1.0:1787790683.644842:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f47840 x1874634267987456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644849:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790683.644855:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787790683.644863:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787790683.644867:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787790683.644869:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787790683.644875:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634267987456:0@lo:38: 00000100:00100000:1.0:1787790683.644899:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267987712:0@lo:400: 00010000:00080000:1.0:1787790683.644908:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f45680 x1874634267988224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644915:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634267988224:0@lo:400: 00010000:00080000:1.0:1787790683.644924:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f44780 x1874634267987584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644937:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634267987584:0@lo:400: 00010000:00080000:1.0:1787790683.644948:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4f44000 x1874634267988096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.644954:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634267988096:0@lo:400: 00000100:00100000:3.0:1787790683.645186:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267987840:12345-0@lo:400: Request processed in 1623us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.645192:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:01000004:3.0:1787790683.645380:0:9520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787790683.645394:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff916fc34ab370) 00000020:00000080:3.0:1787790683.645412:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1787790683.645479:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f67a4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787790683.645482:0:9520:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f67a4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787790683.645485:0:9520:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67a4800 3 00010000:00080000:3.0:1787790683.645509:0:9520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc344c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.122@tcp at head 00000100:00100000:1.0:1787790683.646010:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267987840:0@lo:400: 00000100:00100000:1.0:1787790683.647501:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1874634267988608:0@lo:901: 00000100:00100000:1.0:1787790683.647572:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.647648:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988608 00000100:00100000:1.0:1787790683.647655:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988608 00000100:00100000:1.0:1787790683.647733:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790683.647857:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1874634267988608:12345-0@lo:901: 00000100:00100000:1.0:1787790683.647945:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1874634267988608:12345-0@lo:901: Request processed in 205us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790683.647953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787790683.647979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790683.647993:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc107f00 going to sleep for 11 seconds 00010000:00080000:1.0:1787790683.648014:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe65a40 x1874634267988608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787790699 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790683.648025:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1874634267988608:0@lo:901: 00010000:00010000:3.0:1787790683.650088:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787790683.650267:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787790683.650312:0:9520:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787790683.650324:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf9477fddcf1d8ec 00000100:00080000:3.0:1787790683.650333:0:9520:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790683.650339:0:9520:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff916fc344c000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790683.650370:0:9520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebe580 x1874634267988736/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790683.650413:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634267988736:0@lo:38: 00000100:00100000:3.0:1787790683.650489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.650549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988736 00000100:00100000:3.0:1787790683.650557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988736 00000100:00100000:3.0:1787790683.650841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787790683.651054:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634267988736:12345-0@lo:38: 00010000:00080000:3.0:1787790683.651085:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1787790683.651130:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf9477fddcf1d8f3 00000004:00100000:3.0:1787790683.651150:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787790683.651184:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9170fbdf1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790683.651578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874634267988736:12345-0@lo:38: Request processed in 728us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.651625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787790683.651666:0:9520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1787790683.652117:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1787790683.652911:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787790683.652952:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790683.652975:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790683.652997:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787790683.653048:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787790683.653050:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787790683.653052:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790683.653053:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790683.653055:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790683.653057:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790683.653058:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790683.653059:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790683.653061:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790683.653062:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790683.653064:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790683.653068:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787790683.653070:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790683.653072:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787790683.653073:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790683.653074:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790683.653075:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790683.653076:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790683.653077:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787790683.653078:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787790683.653079:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787790683.653080:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790683.653081:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790683.653105:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787790683.653122:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267988864:0@lo:253: 00000100:00100000:1.0:1787790683.653186:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790683.653220:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc107f00 going to sleep for 11 seconds 00010000:00080000:0.0:1787790683.658904:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebe580 x1874634267988736/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790683.658920:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790683.658931:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787790683.658940:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787790683.658946:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787790683.658949:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc344c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787790683.658956:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634267988736:0@lo:38: 00000100:00100000:0.0:1787790683.658994:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988864 00000100:00100000:0.0:1787790683.659001:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988864 00000100:00100000:0.0:1787790683.659054:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787790683.659062:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267988864:12345-0@lo:253: 20000000:01000000:0.0:1787790683.659093:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787790683.659109:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787790683.668346:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787790683.668400:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787790683.669201:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+17:9502:x1874634267988864:12345-0@lo:253: Request processed in 10133us (16008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.669216:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787790683.669634:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a75db525-924f-489b-b982-1d04f64567fb:9502:1874634267988864:0@lo:253: 10000000:01000000:0.0:1787790683.669651:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787790683.669655:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787790683.669656:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787790683.669658:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790683.669659:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790683.669661:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790683.669662:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790683.669663:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790683.669665:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787790683.669666:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787790683.669679:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790683.669680:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787790683.669699:0:9502:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787790683.671732:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790683.671751:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790683.671779:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.671797:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.671805:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.671813:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.671856:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.671873:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 16 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.671887:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267988992:0@lo:104: 00000100:00100000:2.0:1787790683.671979:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790683.672042:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.672051:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 16 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790683.672066:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267989120:0@lo:104: 00000100:00100000:2.0:1787790683.672089:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790683.672105:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30300 going to sleep for 11 seconds 00000100:00100000:3.0:1787790683.672209:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267988992 00000100:00100000:3.0:1787790683.672221:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267988992 00000100:00100000:3.0:1787790683.672271:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989120 00000100:00100000:3.0:1787790683.672273:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989120 00000100:00100000:3.0:1787790683.672286:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790683.672293:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:6528:x1874634267988992:12345-0@lo:104: 00010000:00010000:3.0:1787790683.672304:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672355:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790683.672360:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:6528:x1874634267988992:12345-0@lo:104: Request processed in 68us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.672367:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790683.672381:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790683.672387:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267989120:12345-0@lo:104: 00010000:00010000:3.0:1787790683.672393:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672428:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787790683.672434:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:6528:x1874634267989120:12345-0@lo:104: Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.672439:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787790683.672458:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790683.672464:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672472:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790683.672476:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672496:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790683.672504:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790683.672510:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790683.672536:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672541:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790683.672557:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672563:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030200/0xcf9477fddcf1d82f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d836 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672575:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790683.672579:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672608:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790683.672611:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672617:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790683.672624:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790683.672634:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790683.672649:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672655:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790683.672660:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672666:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d7e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d7f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672676:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790683.672677:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790683.672679:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790683.672697:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267989248:0@lo:103: 00000100:00100000:3.0:1787790683.672760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.672782:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790683.672788:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267989376:0@lo:103: 00000100:00100000:3.0:1787790683.672807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790683.672833:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989248 00000100:00100000:3.0:1787790683.672836:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989248 00010000:00010000:3.0:1787790683.672851:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 17 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.672870:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989376 00000100:00100000:3.0:1787790683.672873:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989376 00010000:00010000:3.0:1787790683.672884:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 18 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.672913:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790683.672920:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+18:3640:x1874634267989248:12345-0@lo:103: 00010000:00010000:3.0:1787790683.672930:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790683.672935:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 18 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672945:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 18 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.672959:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790683.672986:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+18:3640:x1874634267989248:12345-0@lo:103: Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.672992:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790683.673006:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790683.673012:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+17:3640:x1874634267989376:12345-0@lo:103: 00010000:00010000:3.0:1787790683.673020:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790683.673024:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 17 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673032:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 17 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673042:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673050:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787790683.673071:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008159108s 00010000:00010000:3.0:1787790683.673075:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673082:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673088:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673095:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673101:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790683.673104:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673111:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673119:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673128:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790683.673151:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+17:3640:x1874634267989376:12345-0@lo:103: Request processed in 140us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790683.673157:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790683.673199:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267989376:0@lo:103: 00000100:00100000:3.0:1787790683.673206:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634267989248:0@lo:103: 00010000:00010000:3.0:1787790683.673244:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1d836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d82f expref: 16 pid: 6505 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.673254:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267988992:0@lo:104: 00010000:00010000:3.0:1787790683.673263:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d7f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d7e9 expref: 15 pid: 6507 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790683.673269:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874634267989120:0@lo:104: 00010000:00010000:3.0:1787790683.673280:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673289:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673295:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790683.673301:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38a00/0xcf9477fddcf1d8fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790683.673805:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787790683.677078:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787790683.677262:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787790683.677460:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787790683.678436:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787790683.678958:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787790683.679145:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787790683.680815:0:9502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787790683.689276:0:9502:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787790683.689287:0:9502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787790683.689326:0:9502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787790683.689369:0:9502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787790683.689389:0:9502:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787790683.689413:0:9502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787790683.694312:0:9502:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790683.694500:0:9502:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787790683.979929:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787790684.515385:0:9577:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790684.515814:0:9577:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787790685.003162:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790685.004103:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267989504:0@lo:13: 00000100:00100000:3.0:1787790685.004211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790685.004556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267989632:0@lo:13: 00000100:00100000:0.0:1787790685.004603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790685.004653:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989504 00000100:00100000:0.0:1787790685.004659:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989504 00000100:00100000:0.0:1787790685.004701:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989632 00000100:00100000:0.0:1787790685.004729:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989632 00000100:00100000:0.0:1787790685.004749:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790685.004758:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267989504:12345-0@lo:13: 00002000:00000024:0.0:1787790685.004790:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790685.016408:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267989504:12345-0@lo:13: Request processed in 11638us (12185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790685.016426:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790685.016466:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790685.016483:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267989632:12345-0@lo:13: 00002000:00000024:0.0:1787790685.016509:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790685.016596:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267989632:12345-0@lo:13: Request processed in 111us (11982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790685.016603:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787790685.016631:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790685.016670:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373ad00 x1874634267989632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790685.016692:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267989632:0@lo:13: 00010000:00080000:1.0:1787790685.020347:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37392c0 x1874634267989504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790685.020374:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267989504:0@lo:13: 00010000:00010000:2.0:1787790686.027280:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790686.029094:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267989760:0@lo:41: 00000100:00100000:3.0:1787790686.029168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790686.029242:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989760 00000100:00100000:3.0:1787790686.029250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989760 00000100:00100000:3.0:1787790686.029294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790686.029302:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267989760:12345-0@lo:41: 00000004:00000024:3.0:1787790686.029334:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787790686.029377:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267989760:12345-0@lo:41: Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790686.029384:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790686.029431:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267989760:0@lo:41: 00000100:00100000:1.0:1787790686.034070:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267989888:0@lo:41: 00000100:00100000:1.0:1787790686.034146:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790686.034329:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267989888 00000100:00100000:2.0:1787790686.034337:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267989888 00000100:00100000:2.0:1787790686.034391:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790686.034401:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267989888:12345-0@lo:41: 00000004:00000024:2.0:1787790686.034437:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787790686.034490:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267989888:12345-0@lo:41: Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790686.034497:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790686.034572:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267989888:0@lo:41: 00010000:00010000:3.0:1787790687.051040:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790688.074860:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790689.099177:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267990016:0@lo:400: 00000100:00100000:3.0:1787790689.099257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790689.099428:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990016 00000100:00100000:0.0:1787790689.099448:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990016 00000100:00100000:0.0:1787790689.099500:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787790689.099510:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:3638:x1874634267990016:12345-0@lo:400: 00000100:00100000:0.0:1787790689.099723:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:3638:x1874634267990016:12345-0@lo:400: Request processed in 197us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.099731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787790689.099951:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634267990144:0@lo:400: 00000100:00100000:3.0:1787790689.100185:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634267990016:0@lo:400: 00000100:00100000:3.0:1787790689.100210:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267990528:0@lo:400: 00000100:00100000:3.0:1787790689.100240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790689.100261:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267991040:0@lo:400: 00000100:00100000:3.0:1787790689.100285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790689.100315:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267990272:0@lo:400: 00000100:00100000:3.0:1787790689.100357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790689.100367:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790689.100532:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634267990784:0@lo:400: 00000100:00100000:3.0:1787790689.100568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790689.100633:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634267991296:0@lo:400: 00000100:00100000:3.0:1787790689.100655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790689.100692:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267990400:0@lo:400: 00000100:00100000:1.0:1787790689.100735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790689.100767:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267990912:0@lo:400: 00000100:00100000:1.0:1787790689.100789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790689.101164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990272 00000100:00100000:3.0:1787790689.101171:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990272 00000100:00100000:3.0:1787790689.101205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990400 00000100:00100000:3.0:1787790689.101208:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990400 00000100:00100000:3.0:1787790689.101222:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790689.101230:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267990272:12345-0@lo:400: 00000100:00100000:3.0:1787790689.101280:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634267990272:12345-0@lo:400: Request processed in 51us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790689.101287:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790689.101301:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790689.101307:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267990400:12345-0@lo:400: 00000100:00100000:3.0:1787790689.101342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267990400:12345-0@lo:400: Request processed in 34us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790689.101348:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787790689.101462:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990528 00000100:00100000:0.0:1787790689.101466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990528 00000100:00100000:0.0:1787790689.101490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990784 00000100:00100000:0.0:1787790689.101493:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990784 00000100:00100000:0.0:1787790689.101516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991296 00000100:00100000:0.0:1787790689.101519:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991296 00000100:00100000:0.0:1787790689.101532:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790689.101537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267990528:12345-0@lo:400: 00000100:00100000:0.0:1787790689.101585:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634267990528:12345-0@lo:400: Request processed in 48us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.101590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790689.101602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790689.101607:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634267990784:12345-0@lo:400: 00000100:00100000:0.0:1787790689.101629:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634267990784:12345-0@lo:400: Request processed in 23us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.101634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787790689.101643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790689.101648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634267991296:12345-0@lo:400: 00000100:00100000:0.0:1787790689.101668:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634267991296:12345-0@lo:400: Request processed in 20us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.101672:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787790689.101691:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790689.101926:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991040 00000100:00100000:0.0:1787790689.101930:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991040 00000100:00100000:0.0:1787790689.101958:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990912 00000100:00100000:0.0:1787790689.101961:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990912 00000100:00100000:0.0:1787790689.101986:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790689.101992:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267991040:12345-0@lo:400: 00000100:00100000:0.0:1787790689.102034:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267991040:12345-0@lo:400: Request processed in 42us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.102040:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790689.102050:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790689.102056:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267990912:12345-0@lo:400: 00000100:00100000:0.0:1787790689.102256:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267990912:12345-0@lo:400: Request processed in 200us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.102263:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787790689.102288:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790689.102489:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634267990272:0@lo:400: 00010000:00080000:3.0:1787790689.102511:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f45680 x1874634267990784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790689.102523:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634267990784:0@lo:400: 00010000:00080000:3.0:1787790689.102534:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f46940 x1874634267991296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790689.102543:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634267991296:0@lo:400: 00010000:00080000:3.0:1787790689.102594:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f44000 x1874634267990528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790689.102615:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634267990528:0@lo:400: 00010000:00080000:3.0:1787790689.102627:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f47840 x1874634267991040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790689.102635:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267991040:0@lo:400: 00000100:00100000:1.0:1787790689.102955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790689.103201:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634267990656:0@lo:400: 00000100:00100000:1.0:1787790689.103238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790689.103289:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634267991168:0@lo:400: 00000100:00100000:1.0:1787790689.103312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790689.103363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990144 00000100:00100000:0.0:1787790689.103377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990144 00000100:00100000:0.0:1787790689.103407:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267990656 00000100:00100000:0.0:1787790689.103410:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267990656 00000100:00100000:0.0:1787790689.103427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787790689.103434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634267990144:12345-0@lo:400: 00000100:00100000:0.0:1787790689.103470:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634267990144:12345-0@lo:400: Request processed in 37us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.103476:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787790689.103488:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790689.103492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634267990656:12345-0@lo:400: 00000100:00100000:0.0:1787790689.103512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634267990656:12345-0@lo:400: Request processed in 20us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790689.103524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787790689.103539:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787790689.103679:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe65a40 x1874634267990144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790689.103690:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634267990144:0@lo:400: 00010000:00080000:1.0:1787790689.103700:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f44780 x1874634267990656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790689.103745:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634267990656:0@lo:400: 00000100:00100000:1.0:1787790689.103858:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267990400:0@lo:400: 00010000:00080000:1.0:1787790689.103871:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f461c0 x1874634267990912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790689.103879:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267990912:0@lo:400: 00000100:00100000:1.0:1787790689.103899:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991168 00000100:00100000:1.0:1787790689.103903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991168 00000100:00100000:1.0:1787790689.103928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790689.103934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634267991168:12345-0@lo:400: 00000100:00100000:1.0:1787790689.103983:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634267991168:12345-0@lo:400: Request processed in 36us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790689.103989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787790689.104014:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f47c00 x1874634267991168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790689.104034:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634267991168:0@lo:400: 00000100:00080000:1.0:1787790689.104047:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787790689.363945:0:9866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787790690.122875:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267991424:0@lo:13: 00000100:00100000:0.0:1787790690.122953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790690.123013:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991424 00000100:00100000:0.0:1787790690.123022:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991424 00000100:00100000:0.0:1787790690.123072:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790690.123081:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267991424:12345-0@lo:13: 00002000:00000024:0.0:1787790690.123113:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790690.123158:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634267991424:12345-0@lo:13: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790690.123166:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787790690.123233:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb6580 x1874634267991424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790690.123253:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634267991424:0@lo:13: 00010000:00010000:2.0:1787790690.123492:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790690.123980:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790690.123993:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634267991552:0@lo:13: 00000100:00100000:2.0:1787790690.124035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790690.124427:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991552 00000100:00100000:0.0:1787790690.124434:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991552 00000100:00100000:0.0:1787790690.124559:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787790690.124568:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3739e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634267991552:12345-0@lo:13: 00002000:00000024:0.0:1787790690.124587:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790690.124631:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3739e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634267991552:12345-0@lo:13: Request processed in 65us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790690.124638:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787790690.124680:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3738b40 x1874634267991552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790690.124697:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634267991552:0@lo:13: 00000020:00000004:2.0:1787790690.234128:0:9918:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790690.234374:0:9918:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787790691.147051:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267991680:0@lo:41: 00000100:00100000:0.0:1787790691.147126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790691.147571:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991680 00000100:00100000:3.0:1787790691.147581:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991680 00000100:00100000:3.0:1787790691.147645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790691.147654:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267991680:12345-0@lo:41: 00000004:00000024:3.0:1787790691.147689:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787790691.147788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267991680:12345-0@lo:41: Request processed in 135us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790691.147795:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790691.147883:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267991680:0@lo:41: 00000100:00100000:2.0:1787790691.154940:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790691.154967:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267991808:0@lo:41: 00000100:00100000:2.0:1787790691.155036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790691.155098:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790691.155110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991808 00000100:00100000:2.0:1787790691.155117:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991808 00000100:00100000:2.0:1787790691.155178:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787790691.155186:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267991808:12345-0@lo:41: 00000004:00000024:2.0:1787790691.155219:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787790691.155272:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267991808:12345-0@lo:41: Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790691.155279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787790691.155328:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267991808:0@lo:41: 00010000:00010000:2.0:1787790692.171815:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787790692.177446:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790692.177455:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3c78800 from 39 10000000:01000000:2.0:1787790692.177461:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790692.177510:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.177532:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.177543:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790692.177569:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37383c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267991936:0@lo:101: 00000100:00100000:2.0:1787790692.177648:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.177775:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.180364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267991936 00000100:00100000:0.0:1787790692.180390:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267991936 00000100:00100000:0.0:1787790692.180487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787790692.180498:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634267991936:12345-0@lo:101: 00010000:00010000:0.0:1787790692.180514:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790692.180541:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d901 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.180571:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.180583:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.180592:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030000, rc 0) 00000100:00100000:0.0:1787790692.180668:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267991936:12345-0@lo:101: Request processed in 172us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.180675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787790692.180774:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37383c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267991936:0@lo:101: 00010000:00010000:3.0:1787790692.180793:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.180802:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.180899:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992064:0@lo:501: 00000100:00100000:3.0:1787790692.180936:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.185276:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.187207:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992064 00000100:00100000:2.0:1787790692.187219:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992064 00000100:00100000:2.0:1787790692.187273:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787790692.187283:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267992064:12345-0@lo:501: 00000100:00100000:2.0:1787790692.187476:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267992064:12345-0@lo:501: Request processed in 194us (6539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.187494:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787790692.187634:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992064:0@lo:501: 00000100:00100000:1.0:1787790692.187697:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992192:0@lo:503: 00000100:00100000:1.0:1787790692.187781:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.187802:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.187929:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992192 00000100:00100000:2.0:1787790692.187935:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992192 00000100:00100000:2.0:1787790692.187954:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787790692.187959:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267992192:12345-0@lo:503: 00000100:00100000:2.0:1787790692.188048:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267992192:12345-0@lo:503: Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.188055:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787790692.188131:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992192:0@lo:503: 00000100:00100000:1.0:1787790692.195470:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9982:1874634267992320:0@lo:502: 00000100:00100000:1.0:1787790692.195613:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.195676:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.195791:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992320 00000100:00100000:3.0:1787790692.195799:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992320 00000100:00100000:3.0:1787790692.196608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787790692.196622:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9982:x1874634267992320:12345-0@lo:502: 00000100:00100000:3.0:1787790692.197085:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:9982:x1874634267992320:12345-0@lo:502: Request processed in 465us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.197094:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787790692.198030:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9982:1874634267992320:0@lo:502: 00000100:00100000:1.0:1787790692.198110:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9982:1874634267992448:0@lo:502: 00000100:00100000:1.0:1787790692.198166:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.198200:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.199410:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992448 00000100:00100000:0.0:1787790692.199421:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992448 00000100:00100000:0.0:1787790692.199478:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790692.199488:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:9982:x1874634267992448:12345-0@lo:502: 00000100:00100000:0.0:1787790692.199661:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:9982:x1874634267992448:12345-0@lo:502: Request processed in 173us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.199669:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787790692.201056:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9982:1874634267992448:0@lo:502: 00000040:00080000:1.0:1787790692.201101:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787790692.201178:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787790692.201211:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790692.201223:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790692.201233:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790692.201245:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787790692.201248:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787790692.201251:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787790692.201286:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790692.201295:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790692.201303:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790692.201334:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992576:0@lo:101: 00000100:00100000:1.0:1787790692.201389:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.201421:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.202178:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992576 00000100:00100000:3.0:1787790692.202188:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992576 00000100:00100000:3.0:1787790692.202241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787790692.202252:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634267992576:12345-0@lo:101: 00010000:00010000:3.0:1787790692.202266:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790692.202282:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d90f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.202309:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.202321:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.202330:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:3.0:1787790692.202387:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267992576:12345-0@lo:101: Request processed in 137us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.202395:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787790692.202443:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992576:0@lo:101: 00010000:00010000:3.0:1787790692.202459:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.202468:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.202561:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992704:0@lo:501: 00000100:00100000:3.0:1787790692.202592:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.202607:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c537e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.202989:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992704 00000100:00100000:0.0:1787790692.203000:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992704 00000100:00100000:0.0:1787790692.203034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787790692.203042:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267992704:12345-0@lo:501: 00000100:00100000:0.0:1787790692.203164:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267992704:12345-0@lo:501: Request processed in 123us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.203171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787790692.204633:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992704:0@lo:501: 00000100:00100000:3.0:1787790692.204724:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992832:0@lo:503: 00000100:00100000:3.0:1787790692.204795:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.204835:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c537e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.207022:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992832 00000100:00100000:3.0:1787790692.207040:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992832 00000100:00100000:3.0:1787790692.207102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787790692.207111:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267992832:12345-0@lo:503: 00000100:00100000:3.0:1787790692.207257:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267992832:12345-0@lo:503: Request processed in 146us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.207265:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787790692.207327:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267992832:0@lo:503: 00000100:00100000:3.0:1787790692.208974:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9984:1874634267992960:0@lo:502: 00000100:00100000:3.0:1787790692.209044:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.209086:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267992960 00000100:00100000:3.0:1787790692.209092:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267992960 00000100:00100000:3.0:1787790692.209123:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787790692.209131:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:9984:x1874634267992960:12345-0@lo:502: 00000100:00100000:3.0:1787790692.209231:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:9984:x1874634267992960:12345-0@lo:502: Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.209238:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787790692.209291:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.209310:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9984:1874634267992960:0@lo:502: 00000020:01000000:3.0:1787790692.209336:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790692.209346:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790692.209348:0:9984:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787790692.209352:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787790692.209354:0:9984:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787790692.209372:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9984:1874634267993088:0@lo:502: 00000100:00100000:3.0:1787790692.209405:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.209424:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993088 00000100:00100000:3.0:1787790692.209427:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993088 00000100:00100000:3.0:1787790692.209443:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787790692.209448:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:9984:x1874634267993088:12345-0@lo:502: 00000100:00100000:3.0:1787790692.209502:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:9984:x1874634267993088:12345-0@lo:502: Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.209509:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787790692.209548:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.209559:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9984:1874634267993088:0@lo:502: 00000020:01000000:3.0:1787790692.209575:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790692.209579:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790692.209580:0:9984:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787790692.209584:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787790692.209645:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787790692.212785:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787790692.212804:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.212818:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790692.212839:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787790692.212842:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3e20800 from 39 10000000:01000000:3.0:1787790692.212845:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790692.212951:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.212961:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.212971:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.212996:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993216:0@lo:101: 00000100:00100000:3.0:1787790692.213068:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.213112:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.213139:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993216 00000100:00100000:3.0:1787790692.213145:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993216 00000100:00100000:3.0:1787790692.213182:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787790692.213190:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634267993216:12345-0@lo:101: 00010000:00010000:3.0:1787790692.213203:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790692.213215:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d91d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.213238:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.213248:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.213268:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e200, rc 0) 00000100:00100000:3.0:1787790692.213306:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267993216:12345-0@lo:101: Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.213313:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787790692.213355:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993216:0@lo:101: 00010000:00010000:3.0:1787790692.213368:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.213377:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.213427:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993344:0@lo:501: 00000100:00100000:3.0:1787790692.213449:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.213463:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.213472:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993344 00000100:00100000:3.0:1787790692.213475:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993344 00000100:00100000:3.0:1787790692.213490:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787790692.213496:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267993344:12345-0@lo:501: 00000100:00100000:3.0:1787790692.213621:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267993344:12345-0@lo:501: Request processed in 124us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.213628:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787790692.213655:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993344:0@lo:501: 00000100:00100000:3.0:1787790692.213691:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993472:0@lo:503: 00000100:00100000:3.0:1787790692.213753:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.213767:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c537e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.213784:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993472 00000100:00100000:3.0:1787790692.213787:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993472 00000100:00100000:3.0:1787790692.213804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787790692.213810:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267993472:12345-0@lo:503: 00000100:00100000:3.0:1787790692.217806:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267993472:12345-0@lo:503: Request processed in 3982us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.217823:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787790692.217924:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993472:0@lo:503: 00000100:00100000:1.0:1787790692.219950:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9985:1874634267993600:0@lo:502: 00000100:00100000:1.0:1787790692.220035:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.220075:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790692.220773:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993600 00000100:00100000:1.0:1787790692.220781:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993600 00000100:00100000:1.0:1787790692.220814:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787790692.220820:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:9985:x1874634267993600:12345-0@lo:502: 00000100:00100000:1.0:1787790692.221001:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:9985:x1874634267993600:12345-0@lo:502: Request processed in 180us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.221007:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787790692.221054:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9985:1874634267993600:0@lo:502: 00000100:00100000:1.0:1787790692.221095:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9985:1874634267993728:0@lo:502: 00000100:00100000:1.0:1787790692.221123:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.221137:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993728 00000100:00100000:1.0:1787790692.221139:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993728 00000100:00100000:1.0:1787790692.221153:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787790692.221157:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:9985:x1874634267993728:12345-0@lo:502: 00000100:00100000:1.0:1787790692.221209:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:9985:x1874634267993728:12345-0@lo:502: Request processed in 50us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.221215:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787790692.221239:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790692.221247:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9985:1874634267993728:0@lo:502: 00000040:00080000:1.0:1787790692.221264:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787790692.221420:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787790692.221438:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790692.221447:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221455:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790692.221462:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787790692.221464:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f3e20800 from 6 10000000:01000000:3.0:1787790692.221465:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787790692.221485:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221491:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221497:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.221505:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993856:0@lo:101: 00000100:00100000:3.0:1787790692.221559:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.221581:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e4732240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.221594:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993856 00000100:00100000:3.0:1787790692.221597:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993856 00000100:00100000:3.0:1787790692.221615:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787790692.221619:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634267993856:12345-0@lo:101: 00010000:00010000:3.0:1787790692.221625:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790692.221637:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1d932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d92b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221653:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1d932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d92b expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221660:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1d932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d92b expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221740:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e800, rc 0) 00000100:00100000:3.0:1787790692.221762:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267993856:12345-0@lo:101: Request processed in 143us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.221766:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787790692.221789:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993856:0@lo:101: 00010000:00010000:3.0:1787790692.221798:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.221805:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.221839:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993984:0@lo:256: 00000100:00100000:3.0:1787790692.222813:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.222841:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e4732240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.222924:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267993984 00000100:00100000:3.0:1787790692.222929:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267993984 00000100:00100000:3.0:1787790692.222962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790692.222971:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267993984:12345-0@lo:256: 20000000:01000000:3.0:1787790692.222990:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787790692.223007:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787790692.223010:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787790692.223087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267993984:12345-0@lo:256: Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.223094:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790692.223126:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267993984:0@lo:256: 10000000:01000000:3.0:1787790692.223168:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787790692.223176:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223184:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790692.223192:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787790692.223195:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1787790692.223198:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787790692.223222:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223230:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223248:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.223263:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267994112:0@lo:101: 00000100:00100000:3.0:1787790692.223289:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.223303:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e4732240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.223312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994112 00000100:00100000:3.0:1787790692.223315:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994112 00000100:00100000:3.0:1787790692.223330:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790692.223334:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634267994112:12345-0@lo:101: 00010000:00010000:3.0:1787790692.223341:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790692.223350:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d939 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223372:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223381:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223389:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f000, rc 0) 00000100:00100000:3.0:1787790692.223411:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267994112:12345-0@lo:101: Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.223417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790692.223439:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267994112:0@lo:101: 00010000:00010000:3.0:1787790692.223449:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.223465:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.223511:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267994240:0@lo:501: 00000100:00100000:3.0:1787790692.223546:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.223559:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e4732240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.223570:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994240 00000100:00100000:3.0:1787790692.223573:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994240 00000100:00100000:3.0:1787790692.223590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787790692.223595:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267994240:12345-0@lo:501: 00000100:00100000:3.0:1787790692.226069:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267994240:12345-0@lo:501: Request processed in 2465us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.226083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787790692.226389:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267994240:0@lo:501: 00000100:00100000:1.0:1787790692.226451:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267994368:0@lo:503: 00000100:00100000:1.0:1787790692.226507:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.226562:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.227107:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994368 00000100:00100000:0.0:1787790692.227114:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994368 00000100:00100000:0.0:1787790692.227159:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787790692.227169:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267994368:12345-0@lo:503: 00000100:00100000:0.0:1787790692.227289:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267994368:12345-0@lo:503: Request processed in 121us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.227296:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787790692.227351:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267994368:0@lo:503: 00000100:00100000:2.0:1787790692.228430:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9986:1874634267994496:0@lo:502: 00000100:00100000:2.0:1787790692.228492:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.228542:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.228585:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994496 00000100:00100000:3.0:1787790692.228592:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994496 00000100:00100000:3.0:1787790692.228636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787790692.228646:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:9986:x1874634267994496:12345-0@lo:502: 00000100:00100000:3.0:1787790692.240819:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:9986:x1874634267994496:12345-0@lo:502: Request processed in 12161us (12314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.240836:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787790692.241320:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9986:1874634267994496:0@lo:502: 00000020:01000000:2.0:1787790692.241366:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787790692.241378:0:9986:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787790692.241386:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790692.241388:0:9986:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787790692.241394:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787790692.241398:0:9986:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:2.0:1787790692.241431:0:9986:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787790692.241435:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790692.241452:0:9986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9170fbeeb370) 00000020:00000080:2.0:1787790692.241478:0:9986:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787790692.241485:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787790692.241613:0:9986:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787790692.241620:0:9986:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787790692.241627:0:9986:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1d94e 00010000:00080000:2.0:1787790692.241659:0:9986:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc31fa000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787790692.245963:0:9986:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787790692.246131:0:9986:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787790692.246148:0:9986:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787790692.246336:0:9986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790692.246451:0:9986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790692.246624:0:9986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787790692.246766:0:9986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787790692.250933:0:9988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790692.250943:0:9988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787790692.255349:0:9986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787790692.255362:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787790692.255402:0:9986:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787790692.255428:0:9986:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d955 00000100:00080000:2.0:1787790692.255438:0:9986:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787790692.255443:0:9986:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff916fc31fa000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790692.255475:0:9986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc373b840 x1874634267994624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790692.255493:0:9986:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787790692.255543:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790692.255548:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790692.255550:0:9986:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787790692.255553:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790692.255557:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790692.255558:0:9986:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787790692.255561:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787790692.255563:0:9986:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787790692.255590:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3739680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9986:1874634267994752:0@lo:502: 00000100:00100000:2.0:1787790692.255664:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.255728:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.255817:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267994880:0@lo:400: 00000100:00100000:2.0:1787790692.255853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.255872:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634267995392:0@lo:400: 00000100:00100000:2.0:1787790692.255897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.255911:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634267995904:0@lo:400: 00000100:00100000:2.0:1787790692.255930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.255947:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787790692.255953:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267995264:0@lo:400: 00000100:00100000:2.0:1787790692.255973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.255983:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267995776:0@lo:400: 00000100:00100000:2.0:1787790692.256004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.256089:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634267994624:0@lo:8: 00000100:00100000:0.0:1787790692.256119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.256165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994880 00000100:00100000:0.0:1787790692.256171:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994880 00000100:00100000:0.0:1787790692.256204:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995392 00000100:00100000:0.0:1787790692.256207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995392 00000100:00100000:0.0:1787790692.256229:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995904 00000100:00100000:0.0:1787790692.256232:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995904 00000100:00100000:0.0:1787790692.256243:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995264 00000100:00100000:0.0:1787790692.256247:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995264 00000100:00100000:0.0:1787790692.256260:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790692.256267:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267994880:12345-0@lo:400: 00000100:00100000:0.0:1787790692.256325:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634267994880:12345-0@lo:400: Request processed in 58us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.256332:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790692.256345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790692.256352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634267995392:12345-0@lo:400: 00000100:00100000:0.0:1787790692.256375:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634267995392:12345-0@lo:400: Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.256381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790692.256391:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787790692.256397:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634267995904:12345-0@lo:400: 00000100:00100000:0.0:1787790692.256423:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634267995904:12345-0@lo:400: Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.256428:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787790692.256438:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787790692.256444:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267995264:12345-0@lo:400: 00000100:00100000:0.0:1787790692.256468:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634267995264:12345-0@lo:400: Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.256473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787790692.256489:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995776 00000100:00100000:0.0:1787790692.256492:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995776 00000100:00100000:0.0:1787790692.256515:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994624 00000100:00100000:0.0:1787790692.256529:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994624 00000100:00100000:0.0:1787790692.256542:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790692.256547:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267995776:12345-0@lo:400: 00000100:00100000:0.0:1787790692.256576:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634267995776:12345-0@lo:400: Request processed in 28us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.256590:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790692.256602:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790692.256606:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874634267994624:12345-0@lo:8: 00010000:00080000:0.0:1787790692.256627:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:0.0:1787790692.256649:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1d95c 00002000:00100000:0.0:1787790692.256663:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff916fc1cf0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787790692.256667:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1787790692.256671:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787790692.256754:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787790692.256990:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787790692.257013:0:8426:0:(import.c:65:import_set_state_nolock()) ffff916fc1cf6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790692.257053:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634267994624:12345-0@lo:8: Request processed in 444us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.257060:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787790692.257096:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373b840 x1874634267994624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.257107:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790692.257114:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787790692.257121:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787790692.257126:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787790692.257129:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc31fa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787790692.257140:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787790692.257144:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634267994624:0@lo:8: 00010000:00080000:0.0:1787790692.257186:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37383c0 x1874634267995264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.257206:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634267995264:0@lo:400: 00010000:00080000:0.0:1787790692.257218:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37392c0 x1874634267995776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.257226:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267995776:0@lo:400: 00010000:00080000:0.0:1787790692.257237:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3738000 x1874634267994880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.257244:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634267994880:0@lo:400: 00010000:00080000:0.0:1787790692.257253:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3738b40 x1874634267995392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.257259:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634267995392:0@lo:400: 00010000:00080000:0.0:1787790692.257271:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373ad00 x1874634267995904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.257278:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634267995904:0@lo:400: 00000004:00080000:0.0:1787790692.257306:0:9988:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787790692.257358:0:9988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 241205652502ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787790692.257365:0:9988:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787790692.257483:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267996160:0@lo:700: 00000100:00100000:2.0:1787790692.257518:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.257556:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.257600:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996160 00000100:00100000:0.0:1787790692.257604:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996160 00000100:00100000:0.0:1787790692.257639:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790692.257646:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9989:x1874634267996160:12345-0@lo:700: 00000100:00100000:0.0:1787790692.257673:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8435:1874634267996288:0@lo:700: 00000100:00100000:0.0:1787790692.257700:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.257745:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.257768:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996288 00000100:00100000:0.0:1787790692.257772:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996288 00000100:00100000:0.0:1787790692.257797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790692.257804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8435:x1874634267996288:12345-0@lo:700: 00000100:00100000:1.0:1787790692.258012:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267995008:0@lo:400: 00000100:00100000:1.0:1787790692.258046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.258073:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634267995520:0@lo:400: 00000100:00100000:1.0:1787790692.258095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.258120:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634267996032:0@lo:400: 00000100:00100000:1.0:1787790692.258145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.258159:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787790692.258164:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267995136:0@lo:400: 00000100:00100000:1.0:1787790692.258184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.258202:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267995648:0@lo:400: 00000100:00100000:1.0:1787790692.258222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.258253:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995520 00000100:00100000:1.0:1787790692.258256:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995520 00000100:00100000:1.0:1787790692.258277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996032 00000100:00100000:1.0:1787790692.258279:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996032 00000100:00100000:1.0:1787790692.258293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790692.258299:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc30892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634267995520:12345-0@lo:400: 00000100:00100000:1.0:1787790692.258337:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc30892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634267995520:12345-0@lo:400: Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.258344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790692.258360:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787790692.258374:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634267996032:12345-0@lo:400: 00000100:00100000:1.0:1787790692.258404:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634267996032:12345-0@lo:400: Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.258410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787790692.258427:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790692.258431:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790692.258433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790692.258435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790692.258460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995008 00000100:00100000:1.0:1787790692.258464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995008 00000100:00100000:1.0:1787790692.258488:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995136 00000100:00100000:1.0:1787790692.258491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995136 00000100:00100000:1.0:1787790692.258504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790692.258511:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267995008:12345-0@lo:400: 00000100:00100000:1.0:1787790692.258553:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267995008:12345-0@lo:400: Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.258559:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790692.258570:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790692.258575:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3088f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267995136:12345-0@lo:400: 00000100:00100000:1.0:1787790692.258603:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3088f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267995136:12345-0@lo:400: Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.258608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790692.258623:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267995648 00000100:00100000:1.0:1787790692.258626:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267995648 00000100:00100000:1.0:1787790692.258654:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790692.258660:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267995648:12345-0@lo:400: 00000100:00100000:1.0:1787790692.258687:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634267995648:12345-0@lo:400: Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.258728:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790692.258761:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267995136:0@lo:400: 00010000:00080000:1.0:1787790692.258774:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3738f00 x1874634267995648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790692.258783:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634267995648:0@lo:400: 00000100:00100000:1.0:1787790692.258792:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267995008:0@lo:400: 00010000:00080000:1.0:1787790692.258801:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373bc00 x1874634267995520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790692.258810:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634267995520:0@lo:400: 00010000:00080000:1.0:1787790692.258818:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373a940 x1874634267996032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790692.258825:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634267996032:0@lo:400: 00000100:00080000:1.0:1787790692.258851:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790692.262320:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267994752 00000100:00100000:3.0:1787790692.262337:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267994752 00000100:00100000:3.0:1787790692.262394:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787790692.262404:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:9986:x1874634267994752:12345-0@lo:502: 00000100:00100000:3.0:1787790692.262589:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:9986:x1874634267994752:12345-0@lo:502: Request processed in 185us (6923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.262605:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000004:00080000:3.0:1787790692.264427:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787790692.266106:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3739680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9986:1874634267994752:0@lo:502: 00000020:01000000:0.0:1787790692.266160:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790692.266170:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790692.266172:0:9986:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787790692.266178:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787790692.269679:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787790692.269749:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787790692.269762:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.269771:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790692.269780:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790692.269782:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170c2ab0800 from 39 10000000:01000000:2.0:1787790692.269784:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790692.269826:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.269831:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.269839:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790692.269945:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267996416:0@lo:101: 00000100:00100000:2.0:1787790692.270023:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.270064:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771180 going to sleep for 11 seconds 40000000:02000000:2.0:1787790692.274926:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1787790692.275811:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996416 00000100:00100000:3.0:1787790692.275823:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996416 00000100:00100000:3.0:1787790692.275873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787790692.275880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634267996416:12345-0@lo:101: 00010000:00010000:3.0:1787790692.275896:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790692.275912:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d963 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.275941:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.275953:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.275963:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f600, rc 0) 00000100:00100000:3.0:1787790692.276047:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267996416:12345-0@lo:101: Request processed in 167us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.276054:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787790692.276113:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267996416:0@lo:101: 00010000:00010000:3.0:1787790692.276127:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.276134:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.276200:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267996544:0@lo:501: 00000100:00100000:3.0:1787790692.276244:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.276755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996544 00000100:00100000:1.0:1787790692.276761:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996544 00000100:00100000:1.0:1787790692.276788:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787790692.276794:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267996544:12345-0@lo:501: 00000100:00100000:3.0:1787790692.276945:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d16fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790692.280191:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267996544:12345-0@lo:501: Request processed in 3384us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.280208:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787790692.280896:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267996544:0@lo:501: 00000100:00100000:1.0:1787790692.280966:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267996672:0@lo:503: 00000100:00100000:1.0:1787790692.281033:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.281078:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790692.281095:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996672 00000100:00100000:1.0:1787790692.281101:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996672 00000100:00100000:1.0:1787790692.281186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787790692.281196:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267996672:12345-0@lo:503: 00000100:00100000:1.0:1787790692.281377:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267996672:12345-0@lo:503: Request processed in 181us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.281384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787790692.282132:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8435:x1874634267996288:12345-0@lo:700: Request processed in 24325us (24428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.282141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787790692.284010:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb43c0 x1874634267996288/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.284030:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8435:1874634267996288:0@lo:700: 40000000:02000000:0.0:1787790692.284044:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1787790692.284247:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267996672:0@lo:503: 00000100:00100000:3.0:1787790692.286951:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9990:1874634267996800:0@lo:502: 00000100:00100000:3.0:1787790692.287034:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.287079:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d16fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790692.287353:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996800 00000100:00100000:1.0:1787790692.287360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996800 00000100:00100000:1.0:1787790692.287409:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787790692.287418:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:9990:x1874634267996800:12345-0@lo:502: 00000100:00100000:1.0:1787790692.287555:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:9990:x1874634267996800:12345-0@lo:502: Request processed in 137us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.287563:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787790692.288684:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9990:1874634267996800:0@lo:502: 00000100:00100000:3.0:1787790692.288776:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9990:1874634267996928:0@lo:502: 00000100:00100000:3.0:1787790692.288825:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.288848:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d16fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790692.289195:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267996928 00000100:00100000:1.0:1787790692.289201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267996928 00000100:00100000:1.0:1787790692.289361:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787790692.289370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:9990:x1874634267996928:12345-0@lo:502: 00000100:00100000:1.0:1787790692.289474:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:9990:x1874634267996928:12345-0@lo:502: Request processed in 105us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.289482:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787790692.291305:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9990:1874634267996928:0@lo:502: 00000040:00080000:2.0:1787790692.291349:0:9990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787790692.293642:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787790692.294002:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790692.294016:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790692.294040:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790692.294050:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787790692.294053:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170c2ab0800 from 6 10000000:01000000:1.0:1787790692.294056:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790692.294096:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790692.294104:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790692.294115:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790692.294137:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997056:0@lo:101: 00000100:00100000:1.0:1787790692.294206:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.294253:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.294617:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997056 00000100:00100000:3.0:1787790692.294629:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997056 00000001:00100000:2.0:1787790692.294654:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787790692.294800:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9989:x1874634267996160:12345-0@lo:700: Request processed in 37152us (37280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.294811:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787790692.294834:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd2940 x1874634267996160/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790692.294858:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267996160:0@lo:700: 00000100:00100000:2.0:1787790692.295612:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787790692.295627:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634267997056:12345-0@lo:101: 00010000:00010000:2.0:1787790692.295644:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790692.295667:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d971 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.295699:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d971 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.295728:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d971 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.295748:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39e00, rc 0) 00000100:00100000:2.0:1787790692.295808:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634267997056:12345-0@lo:101: Request processed in 185us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.295815:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787790692.295837:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997056:0@lo:101: 00010000:00010000:3.0:1787790692.295853:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.295863:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.295922:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997184:0@lo:256: 00000100:00100000:3.0:1787790692.295958:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.295994:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d16fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.296045:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997184 00000100:00100000:2.0:1787790692.296051:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997184 00000100:00100000:2.0:1787790692.296077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787790692.296083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634267997184:12345-0@lo:256: 20000000:01000000:2.0:1787790692.296095:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787790692.296110:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787790692.296113:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787790692.296253:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634267997184:12345-0@lo:256: Request processed in 169us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.296260:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787790692.296370:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997184:0@lo:256: 10000000:01000000:3.0:1787790692.296415:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787790692.296421:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.296429:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790692.296442:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787790692.296444:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787790692.296447:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790692.296464:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.296471:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.296479:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.296489:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997312:0@lo:101: 00000100:00100000:3.0:1787790692.296512:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.296545:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d16fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.296595:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997312 00000100:00100000:2.0:1787790692.296599:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997312 00000100:00100000:2.0:1787790692.296629:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787790692.296635:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634267997312:12345-0@lo:101: 00010000:00010000:2.0:1787790692.296642:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790692.296651:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d97f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.296665:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.296673:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.296690:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38600, rc 0) 00000100:00100000:2.0:1787790692.296737:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634267997312:12345-0@lo:101: Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.296743:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787790692.297663:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997312:0@lo:101: 00010000:00010000:3.0:1787790692.297678:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790692.297685:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790692.297758:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997440:0@lo:501: 00000100:00100000:2.0:1787790692.297813:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.297849:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d16fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.297880:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997440 00000100:00100000:3.0:1787790692.297885:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997440 00000100:00100000:3.0:1787790692.297916:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787790692.297923:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634267997440:12345-0@lo:501: 00000100:00100000:3.0:1787790692.298068:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634267997440:12345-0@lo:501: Request processed in 144us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.298075:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787790692.298083:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997440:0@lo:501: 00000100:00100000:2.0:1787790692.298111:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997568:0@lo:503: 00000100:00100000:2.0:1787790692.298152:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.298183:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.298319:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997568 00000100:00100000:3.0:1787790692.298323:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997568 00000100:00100000:3.0:1787790692.298346:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787790692.298352:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634267997568:12345-0@lo:503: 00000100:00100000:3.0:1787790692.298431:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634267997568:12345-0@lo:503: Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.298437:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787790692.298441:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267997568:0@lo:503: 00000100:00100000:2.0:1787790692.298847:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9992:1874634267997696:0@lo:502: 00000100:00100000:2.0:1787790692.298879:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.298920:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.298965:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997696 00000100:00100000:3.0:1787790692.298969:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997696 00000100:00100000:3.0:1787790692.298995:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787790692.299003:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:9992:x1874634267997696:12345-0@lo:502: 00000100:00100000:3.0:1787790692.299083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:9992:x1874634267997696:12345-0@lo:502: Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.299089:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787790692.299124:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9992:1874634267997696:0@lo:502: 00000020:01000000:3.0:1787790692.299145:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790692.299150:0:9992:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787790692.299155:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790692.299157:0:9992:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787790692.299161:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790692.299165:0:9992:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787790692.299189:0:9992:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787790692.299191:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790692.299207:0:9992:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff916fc34a99b8) 00000020:00000080:3.0:1787790692.299232:0:9992:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787790692.299237:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790692.299304:0:9992:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787790692.299309:0:9992:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787790692.299313:0:9992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1d994 00010000:00080000:3.0:1787790692.299334:0:9992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc3449000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790692.299537:0:9992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787790692.299804:0:9992:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787790692.299816:0:9992:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787790692.300278:0:9992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790692.300409:0:9992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790692.300555:0:9992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787790692.300649:0:9992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:3.0:1787790692.301557:0:9989:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787790692.301593:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267997952:0@lo:7: 00000040:00080000:1.0:1787790692.301891:0:9994:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790692.301896:0:9994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1787790692.302367:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.302400:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.302422:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267997824:0@lo:13: 00000100:00100000:3.0:1787790692.302449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.302486:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997824 00000100:00100000:3.0:1787790692.302493:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997824 00000100:00100000:3.0:1787790692.302547:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790692.302557:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267997824:12345-0@lo:13: 00002000:00000024:3.0:1787790692.302586:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787790692.302644:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634267997824:12345-0@lo:13: Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.302651:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790692.302765:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267997952 00000100:00100000:1.0:1787790692.302770:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267997952 00000100:00100000:1.0:1787790692.302800:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790692.302808:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9989:x1874634267997952:12345-0@lo:7: 00010000:00080000:2.0:1787790692.303077:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f0c0 x1874634267997824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790692.303097:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634267997824:0@lo:13: 00002000:00080000:1.0:1787790692.312429:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787790692.312439:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787790692.312597:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9989:x1874634267997952:12345-0@lo:7: Request processed in 9784us (10225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790692.312614:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:1.0:1787790692.313297:0:9992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787790692.313311:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787790692.313361:0:9992:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787790692.313392:0:9992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d99b 00000100:00080000:1.0:1787790692.313400:0:9992:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790692.313405:0:9992:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff916fc3449000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790692.313437:0:9992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3089e00 x1874634267998080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790692.313454:0:9992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787790692.313507:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790692.313511:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790692.313513:0:9992:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787790692.313516:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790692.313530:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790692.313531:0:9992:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787790692.313535:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787790692.313537:0:9992:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787790692.313567:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc30883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9992:1874634267998208:0@lo:502: 00000100:00100000:1.0:1787790692.313625:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.313660:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.313662:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998208 00000100:00100000:2.0:1787790692.313668:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998208 00000100:00100000:2.0:1787790692.313735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787790692.313744:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:9992:x1874634267998208:12345-0@lo:502: 00000100:00100000:2.0:1787790692.313859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:9992:x1874634267998208:12345-0@lo:502: Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.313867:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787790692.314159:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3089e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267998080:0@lo:8: 00000100:00100000:0.0:1787790692.314199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790692.314467:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc30883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:9992:1874634267998208:0@lo:502: 00000020:01000000:1.0:1787790692.314502:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790692.314506:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790692.314508:0:9992:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787790692.314513:0:9992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1787790692.315768:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1787790692.315794:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787790692.315804:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.315813:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790692.315821:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787790692.315828:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9170d6383370 from 1 10000000:01000000:0.0:1787790692.315830:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787790692.315861:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.315866:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.315873:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790692.315885:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267998336:0@lo:101: 00000100:00100000:0.0:1787790692.315931:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.315973:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.316016:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998336 00000100:00100000:2.0:1787790692.316023:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998336 00000100:00100000:2.0:1787790692.316064:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787790692.316073:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634267998336:12345-0@lo:101: 00010000:00010000:2.0:1787790692.316085:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790692.316098:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1d9a2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.316121:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.316133:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790692.316141:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38e00, rc 0) 00000100:00100000:2.0:1787790692.316201:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634267998336:12345-0@lo:101: Request processed in 128us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.316208:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787790692.316357:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267998336:0@lo:101: 00010000:00010000:0.0:1787790692.316373:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.316382:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790692.316436:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267998464:0@lo:501: 00000100:00100000:0.0:1787790692.316462:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.316480:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.316493:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998464 00000100:00100000:2.0:1787790692.316497:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998464 00000100:00100000:2.0:1787790692.316542:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787790692.316548:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634267998464:12345-0@lo:501: 00000100:00100000:2.0:1787790692.316638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634267998464:12345-0@lo:501: Request processed in 90us (175us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790692.316651:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787790692.316772:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634267998464:0@lo:501: 10000000:01000000:0.0:1787790692.316793:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787790692.316799:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790692.316813:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787790692.317384:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373e1c0 x1874634267997952/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.317398:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267997952:0@lo:7: 00000004:00080000:3.0:1787790692.317409:0:9989:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787790692.317433:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267998592:0@lo:5: 00000100:00100000:3.0:1787790692.317459:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.317487:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.317505:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998592 00000100:00100000:3.0:1787790692.317510:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998592 00000100:00100000:2.0:1787790692.317576:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998080 00000100:00100000:2.0:1787790692.317581:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998080 00000100:00100000:3.0:1787790692.317907:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790692.317918:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9989:x1874634267998592:12345-0@lo:5: 00002000:00080000:3.0:1787790692.317940:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787790692.317976:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9989:x1874634267998592:12345-0@lo:5: Request processed in 60us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.317983:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790692.317998:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790692.318002:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874634267998080:12345-0@lo:8: 00010000:00080000:3.0:1787790692.318025:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1787790692.318058:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1d9b0 00002000:00100000:3.0:1787790692.318071:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff916fc344b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787790692.318075:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787790692.318078:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787790692.318156:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787790692.318255:0:8427:0:(import.c:65:import_set_state_nolock()) ffff916fc344e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790692.318305:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634267998080:12345-0@lo:8: Request processed in 301us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.318312:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787790692.320682:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3089e00 x1874634267998080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.320730:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787790692.320744:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787790692.320755:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787790692.320763:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787790692.320776:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc3449000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787790692.320794:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787790692.320803:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3089e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634267998080:0@lo:8: 00010000:00080000:3.0:1787790692.320853:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373e1c0 x1874634267998592/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.320863:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267998592:0@lo:5: 00000004:00080000:3.0:1787790692.320877:0:9989:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787790692.320920:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267998720:0@lo:5: 00000100:00100000:3.0:1787790692.320977:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.321009:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998720 00000100:00100000:3.0:1787790692.321015:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998720 00000100:00100000:3.0:1787790692.321060:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790692.321071:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9989:x1874634267998720:12345-0@lo:5: 00002000:00080000:3.0:1787790692.321110:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1787790692.322755:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9989:x1874634267998720:12345-0@lo:5: Request processed in 1681us (1773us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787790692.322767:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790692.322856:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eba80 going to sleep for 11 seconds 00010000:00080000:3.0:1787790692.322879:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373e1c0 x1874634267998720/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.322892:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1874634267998720:0@lo:5: 00000004:00080000:3.0:1787790692.322904:0:9989:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787790692.322940:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9989:1874634267998848:0@lo:900: 00000100:00100000:3.0:1787790692.322972:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.323008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998848 00000100:00100000:3.0:1787790692.323019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998848 00000100:00100000:3.0:1787790692.323059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790692.323068:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9989:x1874634267998848:12345-0@lo:900: 00000100:00100000:3.0:1787790692.323110:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9989:x1874634267998848:12345-0@lo:900: Request processed in 43us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.323115:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790692.323132:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eba80 going to sleep for 11 seconds 00010000:00080000:3.0:1787790692.323144:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f0c0 x1874634267998848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.323153:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9989:1874634267998848:0@lo:900: 00000004:00080000:1.0:1787790692.323495:0:9994:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787790692.323758:0:9994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 241272051565ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787790692.323764:0:9994:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787790692.330784:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1787790692.331025:0:9995:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787790692.331057:0:9995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999104:0@lo:7: 00000100:00100000:2.0:1787790692.331133:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.331174:0:9995:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.331774:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999104 00000100:00100000:2.0:1787790692.331782:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999104 00000100:00080000:1.0:1787790692.331820:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790692.331844:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790692.331852:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9995:x1874634267999104:12345-0@lo:7: 00000100:00100000:0.0:1787790692.335059:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267998976:0@lo:13: 00000100:00100000:0.0:1787790692.335146:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.335314:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267998976 00000100:00100000:0.0:1787790692.335321:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267998976 00000100:00100000:0.0:1787790692.335368:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790692.335378:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874634267998976:12345-0@lo:13: 00002000:00000024:0.0:1787790692.335401:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1787790692.335445:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874634267998976:12345-0@lo:13: Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790692.335451:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787790692.335496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd2d00 x1874634267998976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.335515:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634267998976:0@lo:13: 00000004:00080000:0.0:1787790692.339292:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1787790692.345648:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787790692.345659:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787790692.345783:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9995:x1874634267999104:12345-0@lo:7: Request processed in 13925us (14643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790692.345795:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787790692.354693:0:9995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd0f00 x1874634267999104/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.354730:0:9995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999104:0@lo:7: 00000004:00080000:0.0:1787790692.354748:0:9995:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787790692.354798:0:9995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999232:0@lo:5: 00000100:00100000:0.0:1787790692.354872:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790692.354924:0:9995:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790692.355077:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999232 00000100:00100000:2.0:1787790692.355084:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999232 00000100:00100000:2.0:1787790692.355144:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790692.355154:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9995:x1874634267999232:12345-0@lo:5: 00002000:00080000:2.0:1787790692.355181:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787790692.355185:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1787790692.360276:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1787790692.360291:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787790692.360296:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787790692.362605:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9995:x1874634267999232:12345-0@lo:5: Request processed in 7444us (7724us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787790692.362620:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787790692.362636:0:9995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3738000 x1874634267999232/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790692.362648:0:9995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787790692.362678:0:9995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999232:0@lo:5: 00000004:00080000:2.0:1787790692.362693:0:9995:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787790692.362755:0:9995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999360:0@lo:700: 00000100:00100000:2.0:1787790692.362788:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790692.362821:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999360 00000100:00100000:2.0:1787790692.362825:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999360 00000100:00100000:2.0:1787790692.362864:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790692.362871:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9995:x1874634267999360:12345-0@lo:700: 00000100:00100000:2.0:1787790692.363017:0:9995:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790692.372908:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9995:x1874634267999360:12345-0@lo:700: Request processed in 10016us (10097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790692.372924:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787790692.372993:0:9995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd0b40 x1874634267999360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790692.373010:0:9995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999360:0@lo:700: 00000004:02000040:1.0:1787790692.374820:0:9995:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787790692.384849:0:9995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999488:0@lo:5: 00000100:00100000:3.0:1787790692.384919:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790692.384970:0:9995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790692.385024:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999488 00000100:00100000:0.0:1787790692.385032:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999488 00000100:00100000:0.0:1787790692.385092:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790692.385105:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9995:x1874634267999488:12345-0@lo:5: 00002000:00080000:0.0:1787790692.388367:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787790692.388386:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1787790692.391798:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9995:x1874634267999488:12345-0@lo:5: Request processed in 6686us (6869us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787790692.391811:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787790692.391848:0:9995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f0c0 x1874634267999488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790692.391868:0:9995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9995:1874634267999488:0@lo:5: 00000004:00080000:3.0:1787790692.391884:0:9995:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1787790692.798581:0:10030:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790692.799415:0:10030:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787790693.196372:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787790693.809187:0:10078:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790693.809203:0:10078:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787790694.219030:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790695.243013:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790695.243058:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267999616:0@lo:13: 00000100:00100000:0.0:1787790695.243153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790695.243155:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790695.243202:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999616 00000100:00100000:1.0:1787790695.243212:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999616 00000100:00080000:3.0:1787790695.243253:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790695.243296:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790695.243309:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267999616:12345-0@lo:13: 00002000:00000024:1.0:1787790695.243362:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790695.243417:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787790695.243430:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787790695.244037:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250125696 00000100:00100000:2.0:1787790695.244043:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250125696 00000100:00100000:2.0:1787790695.244072:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 179 00000100:00100000:2.0:1787790695.244079:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1874634250125696:12345-192.168.202.22@tcp:250: 00010000:00080000:2.0:1787790695.244106:0:6507:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 56437f26-ebd6-4232-a9cd-72d1b9652a36@192.168.202.22@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787790695.244141:0:6507:0:(genops.c:1385:class_connect()) connect: client 56437f26-ebd6-4232-a9cd-72d1b9652a36, cookie 0xcf9477fddcf1d9b7 00000100:00100000:3.0:1787790695.244485:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267999744:0@lo:13: 00000100:00100000:1.0:1787790695.245348:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634267999616:12345-0@lo:13: Request processed in 2036us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790695.245365:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787790695.245644:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373b840 x1874634267999616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790695.245671:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634267999616:0@lo:13: 00000100:00080000:2.0:1787790695.251084:0:6507:0:(import.c:65:import_set_state_nolock()) ffff916fc1c8f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790695.251219:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+5:2399:x1874634250125696:12345-192.168.202.22@tcp:250: Request processed in 7132us (8059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.251235:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 179 00010000:00010000:2.0:1787790695.251367:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790695.251551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790695.252538:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999744 00000100:00100000:0.0:1787790695.252549:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999744 00000100:00100000:0.0:1787790695.252635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790695.252648:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267999744:12345-0@lo:13: 00002000:00000024:0.0:1787790695.252677:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787790695.252838:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790695.253412:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267999744:12345-0@lo:13: Request processed in 764us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790695.253422:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787790695.260010:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd0780 x1874634267999744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790695.260050:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267999744:0@lo:13: 00000100:00100000:0.0:1787790695.260400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790695.260489:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250125568 00000100:00100000:3.0:1787790695.260509:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250125568 00000100:00100000:3.0:1787790695.260582:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 180 00000100:00100000:3.0:1787790695.260596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+5:6156:x1874634250125568:12345-192.168.202.22@tcp:101: 00010000:00010000:3.0:1787790695.260616:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790695.260647:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223a24 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.260687:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.260702:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.260758:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e600, rc 0) 00000100:00100000:3.0:1787790695.260837:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+6:6156:x1874634250125568:12345-192.168.202.22@tcp:101: Request processed in 244us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790695.260846:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 180 00000100:00100000:1.0:1787790695.264916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.265190:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250125824 00000100:00100000:2.0:1787790695.265204:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250125824 00000100:00100000:2.0:1787790695.265290:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 181 00000100:00100000:2.0:1787790695.265409:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+6:6156:x1874634250125824:12345-192.168.202.22@tcp:501: 00000100:00100000:2.0:1787790695.265627:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+6:6156:x1874634250125824:12345-192.168.202.22@tcp:501: Request processed in 222us (727us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790695.269767:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790695.269866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250125952 00000100:00100000:0.0:1787790695.269876:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250125952 00000100:00100000:0.0:1787790695.269932:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 182 00000100:00100000:0.0:1787790695.269944:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+7:6156:x1874634250125952:12345-192.168.202.22@tcp:101: 00010000:00010000:0.0:1787790695.269967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790695.269990:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223a2b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790695.270026:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790695.270036:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790695.270044:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030c00, rc 0) 00000100:00100000:0.0:1787790695.270114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6156:x1874634250125952:12345-192.168.202.22@tcp:101: Request processed in 173us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790695.270121:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 182 00000100:00100000:2.0:1787790695.273449:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 181 00000100:00100000:0.0:1787790695.275912:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.277545:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126080 00000100:00100000:2.0:1787790695.277566:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126080 00000100:00100000:2.0:1787790695.277671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 183 00000100:00100000:2.0:1787790695.277686:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+7:6156:x1874634250126080:12345-192.168.202.22@tcp:501: 00000100:00100000:2.0:1787790695.277999:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6156:x1874634250126080:12345-192.168.202.22@tcp:501: Request processed in 315us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.278009:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 183 00000100:00100000:1.0:1787790695.282586:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.282974:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126208 00000100:00100000:2.0:1787790695.282987:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126208 00000100:00100000:2.0:1787790695.283066:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 184 00000100:00100000:2.0:1787790695.283078:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6156:x1874634250126208:12345-192.168.202.22@tcp:503: 00000100:00100000:2.0:1787790695.284482:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6156:x1874634250126208:12345-192.168.202.22@tcp:503: Request processed in 1395us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.284510:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 184 00000100:00100000:1.0:1787790695.301397:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.302584:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126336 00000100:00100000:2.0:1787790695.302599:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126336 00000100:00100000:2.0:1787790695.302688:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 185 00000100:00100000:2.0:1787790695.302701:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6174:x1874634250126336:12345-192.168.202.22@tcp:502: 00000100:00100000:2.0:1787790695.303613:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6174:x1874634250126336:12345-192.168.202.22@tcp:502: Request processed in 909us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.303626:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 185 00000100:00100000:0.0:1787790695.341388:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.341512:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126464 00000100:00100000:2.0:1787790695.341547:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126464 00000100:00100000:2.0:1787790695.341631:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 186 00000100:00100000:2.0:1787790695.341641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6174:x1874634250126464:12345-192.168.202.22@tcp:502: 00000100:00100000:2.0:1787790695.341891:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6174:x1874634250126464:12345-192.168.202.22@tcp:502: Request processed in 250us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.341898:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 186 00000100:00100000:1.0:1787790695.350561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790695.350863:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126592 00000100:00100000:3.0:1787790695.350878:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126592 00000100:00100000:3.0:1787790695.350954:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 187 00000100:00100000:3.0:1787790695.350966:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6156:x1874634250126592:12345-192.168.202.22@tcp:101: 00010000:00010000:3.0:1787790695.350993:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790695.351017:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9f400/0xcf9477fddcf1d9cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223a5c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.351077:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9f400/0xcf9477fddcf1d9cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a5c expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.351091:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9f400/0xcf9477fddcf1d9cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a5c expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.351103:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f400, rc 0) 00000100:00100000:3.0:1787790695.351186:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6156:x1874634250126592:12345-192.168.202.22@tcp:101: Request processed in 221us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790695.351196:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 187 00000100:00100000:1.0:1787790695.360310:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790695.365936:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126720 00000100:00100000:0.0:1787790695.365958:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126720 00000100:00100000:0.0:1787790695.366064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 188 00000100:00100000:0.0:1787790695.366076:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6156:x1874634250126720:12345-192.168.202.22@tcp:256: 20000000:01000000:0.0:1787790695.366141:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787790695.366161:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787790695.366166:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787790695.366169:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787790695.366172:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787790695.366174:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787790695.371949:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6156:x1874634250126720:12345-192.168.202.22@tcp:256: Request processed in 5856us (11641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.371968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 188 00000100:00100000:1.0:1787790695.378038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.383133:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126848 00000100:00100000:2.0:1787790695.383159:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126848 00000100:00100000:3.0:1787790695.389655:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 189 00000100:00100000:3.0:1787790695.389680:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6156:x1874634250126848:12345-192.168.202.22@tcp:101: 00010000:00010000:3.0:1787790695.389728:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790695.389762:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223a63 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.389809:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.389825:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790695.389838:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ea00, rc 0) 00000100:00100000:3.0:1787790695.389933:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6156:x1874634250126848:12345-192.168.202.22@tcp:101: Request processed in 258us (11912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790695.389942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 189 00000100:00100000:1.0:1787790695.394677:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.394831:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250126976 00000100:00100000:2.0:1787790695.394844:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250126976 00000100:00100000:2.0:1787790695.394921:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 190 00000100:00100000:2.0:1787790695.394934:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6156:x1874634250126976:12345-192.168.202.22@tcp:501: 00000100:00100000:2.0:1787790695.395313:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6156:x1874634250126976:12345-192.168.202.22@tcp:501: Request processed in 378us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.395324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 190 00000100:00100000:0.0:1787790695.398171:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.399522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127104 00000100:00100000:2.0:1787790695.399540:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127104 00000100:00100000:2.0:1787790695.399625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 191 00000100:00100000:2.0:1787790695.399637:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6156:x1874634250127104:12345-192.168.202.22@tcp:503: 00000100:00100000:2.0:1787790695.399876:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6156:x1874634250127104:12345-192.168.202.22@tcp:503: Request processed in 240us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.399885:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 191 00000100:00100000:1.0:1787790695.407018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790695.407126:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127232 00000100:00100000:3.0:1787790695.407142:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127232 00000100:00100000:3.0:1787790695.407223:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 192 00000100:00100000:3.0:1787790695.407237:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6178:x1874634250127232:12345-192.168.202.22@tcp:502: 00000100:00100000:3.0:1787790695.407474:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6178:x1874634250127232:12345-192.168.202.22@tcp:502: Request processed in 239us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790695.407482:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 192 00000100:00100000:1.0:1787790695.411263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790695.411450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127360 00000100:00100000:0.0:1787790695.411463:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127360 00000100:00100000:0.0:1787790695.411549:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 193 00000100:00100000:0.0:1787790695.411561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6178:x1874634250127360:12345-192.168.202.22@tcp:502: 00000100:00100000:0.0:1787790695.411967:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6178:x1874634250127360:12345-192.168.202.22@tcp:502: Request processed in 407us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790695.412111:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 193 00000100:00100000:0.0:1787790695.423180:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790695.423259:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790695.423373:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127488 00000100:00100000:2.0:1787790695.423403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127488 00000100:00100000:2.0:1787790695.423459:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127744 00000100:00100000:2.0:1787790695.423462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127744 00000100:00100000:2.0:1787790695.423479:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787790695.423500:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1874634250127488:12345-192.168.202.22@tcp:38: 00010000:00080000:2.0:1787790695.423543:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787790695.423629:0:6514:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1d9da 00000004:00100000:2.0:1787790695.423665:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787790695.424120:0:6514:0:(import.c:65:import_set_state_nolock()) ffff916fc1c8f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790695.424213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250127488:12345-192.168.202.22@tcp:38: Request processed in 723us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.424223:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787790695.424247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787790695.424253:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1874634250127744:12345-192.168.202.22@tcp:38: 00010000:00080000:2.0:1787790695.424270:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787790695.424308:0:6514:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1d9e1 00000004:00100000:2.0:1787790695.424323:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787790695.424532:0:6514:0:(import.c:65:import_set_state_nolock()) ffff916fc1c88000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790695.424559:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250127744:12345-192.168.202.22@tcp:38: Request processed in 304us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790695.424566:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00010000:00010000:2.0:1787790696.267104:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790696.267192:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790696.267224:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267999872:0@lo:41: 00000100:00100000:3.0:1787790696.267333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790696.267861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634267999872 00000100:00100000:1.0:1787790696.267874:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634267999872 00000100:00100000:1.0:1787790696.267939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787790696.267950:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267999872:12345-0@lo:41: 00000004:00000024:1.0:1787790696.267997:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790696.268091:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634267999872:12345-0@lo:41: Request processed in 142us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790696.268099:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787790696.268164:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634267999872:0@lo:41: 00000100:00100000:0.0:1787790696.274694:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268000000:0@lo:41: 00000100:00100000:0.0:1787790696.274838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790696.274996:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000000 00000100:00100000:2.0:1787790696.275008:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000000 00000100:00100000:2.0:1787790696.275087:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787790696.275099:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268000000:12345-0@lo:41: 00000004:00000024:2.0:1787790696.275166:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787790696.275235:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268000000:12345-0@lo:41: Request processed in 138us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790696.275242:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790696.275341:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268000000:0@lo:41: 00000100:00100000:1.0:1787790696.429478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790696.429545:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790696.429602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790696.429698:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128000 00000100:00100000:3.0:1787790696.429765:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128000 00000100:00100000:3.0:1787790696.429844:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127872 00000100:00100000:3.0:1787790696.429848:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127872 00000100:00100000:3.0:1787790696.429865:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250127616 00000100:00100000:3.0:1787790696.429867:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250127616 00000100:00100000:3.0:1787790696.429884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787790696.429894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc30883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:6156:x1874634250128000:12345-192.168.202.22@tcp:41: 00000004:00000024:3.0:1787790696.429947:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787790696.430043:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc30883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:6156:x1874634250128000:12345-192.168.202.22@tcp:41: Request processed in 149us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.430052:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787790696.430072:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:3.0:1787790696.430078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3088780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250127872:12345-192.168.202.22@tcp:41: 00000004:00000024:3.0:1787790696.430091:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787790696.430115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3088780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250127872:12345-192.168.202.22@tcp:41: Request processed in 37us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.430138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:3.0:1787790696.430152:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787790696.430159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250127616:12345-192.168.202.22@tcp:41: 00000004:00000024:3.0:1787790696.430170:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787790696.430192:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250127616:12345-192.168.202.22@tcp:41: Request processed in 33us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.430198:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00080000:1.0:1787790696.430398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790696.430404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790696.435885:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790696.435963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128128 00000100:00100000:3.0:1787790696.435979:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128128 00000100:00100000:3.0:1787790696.436083:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:3.0:1787790696.436099:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:6156:x1874634250128128:12345-192.168.202.22@tcp:40: 00000100:00100000:3.0:1787790696.436239:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:6156:x1874634250128128:12345-192.168.202.22@tcp:40: Request processed in 142us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.436248:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:0.0:1787790696.441968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790696.442162:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790696.442193:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790696.442247:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128512 00000100:00100000:3.0:1787790696.442262:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128512 00000100:00100000:3.0:1787790696.442341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:3.0:1787790696.442354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a61a333f-852a-40de-8207-4f7de209a9a4+6:6156:x1874634250128512:12345-192.168.202.22@tcp:900: 00000100:00100000:3.0:1787790696.442468:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a61a333f-852a-40de-8207-4f7de209a9a4+6:6156:x1874634250128512:12345-192.168.202.22@tcp:900: Request processed in 116us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.442477:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:0.0:1787790696.444131:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790696.444194:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128640 00000100:00100000:1.0:1787790696.444206:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128640 00000100:00100000:1.0:1787790696.444279:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 194 00000100:00100000:1.0:1787790696.444290:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250128640:12345-192.168.202.22@tcp:400: 00000100:00100000:1.0:1787790696.444380:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250128640:12345-192.168.202.22@tcp:400: Request processed in 92us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790696.444389:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 194 00000100:00100000:2.0:1787790696.445015:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128256 00000100:00100000:2.0:1787790696.445024:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128256 00000100:00100000:2.0:1787790696.445213:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128384 00000100:00100000:2.0:1787790696.445218:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128384 00000100:00100000:3.0:1787790696.445453:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790696.445464:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874634250128256:12345-192.168.202.22@tcp:8: 00010000:00080000:3.0:1787790696.445521:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 245 last 0 00000100:00100000:1.0:1787790696.445538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790696.445580:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128768 00000100:00100000:1.0:1787790696.445585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128768 00000020:00000080:3.0:1787790696.445599:0:8428:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1d9e8 00002000:00100000:3.0:1787790696.445617:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a61a333f-852a-40de-8207-4f7de209a9a4/ffff9170fbdf6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1787790696.445619:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:1.0:1787790696.445630:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3089a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:6156:x1874634250128768:12345-192.168.202.22@tcp:33: 00002000:00100000:3.0:1787790696.445645:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790696.446546:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787790696.446994:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170f6791000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790696.451384:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250128256:12345-192.168.202.22@tcp:8: Request processed in 1762us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.451416:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790696.451467:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787790696.451480:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874634250128384:12345-192.168.202.22@tcp:8: 00010000:00080000:3.0:1787790696.451541:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1787790696.451607:0:8428:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1d9ef 00002000:00100000:3.0:1787790696.451634:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a61a333f-852a-40de-8207-4f7de209a9a4/ffff9170f6790000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790696.451663:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790696.451983:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787790696.452733:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170f6790800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790696.452840:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250128384:12345-192.168.202.22@tcp:8: Request processed in 1358us (10642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790696.453551:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000004:00080000:1.0:1787790696.495136:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 49386us 00000004:00200000:0.0:1787790696.544849:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787790696.545170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3089a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:6156:x1874634250128768:12345-192.168.202.22@tcp:33: Request processed in 99534us (99626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790696.545182:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:1.0:1787790696.752967:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790696.753225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250128896 00000100:00100000:2.0:1787790696.753244:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250128896 00000100:00100000:2.0:1787790696.753343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:2.0:1787790696.753359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3089680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:6196:x1874634250128896:12345-192.168.202.22@tcp:101: 00010000:00010000:2.0:1787790696.753392:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790696.753447:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39c00/0xcf9477fddcf1d9f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223a94 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790696.753548:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1d9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790696.753572:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790696.753596:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790696.753671:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790696.753678:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790696.753700:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790696.753779:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39c00/0xcf9477fddcf1d9f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a94 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790696.753815:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1d9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a94 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790696.753833:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3701000) 00010000:00010000:2.0:1787790696.753839:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790696.753925:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39a00, rc 0) 00000100:00100000:2.0:1787790696.754203:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3089680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:6196:x1874634250128896:12345-192.168.202.22@tcp:101: Request processed in 841us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790696.754217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00010000:00010000:2.0:1787790697.292662:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790697.803319:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268000256:0@lo:13: 00000100:00100000:2.0:1787790697.803416:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790697.803429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.803448:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268000128:0@lo:400: 00000100:00100000:0.0:1787790697.803680:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268000384:0@lo:400: 00000100:00100000:0.0:1787790697.803750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790697.803797:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000384 00000100:00100000:0.0:1787790697.803805:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000384 00000100:00100000:0.0:1787790697.803852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790697.803861:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268000384:12345-0@lo:400: 00000100:00100000:0.0:1787790697.803925:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268000384:12345-0@lo:400: Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790697.803932:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790697.803975:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268000384:0@lo:400: 00000100:00100000:0.0:1787790697.804599:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000256 00000100:00100000:0.0:1787790697.804604:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000256 00000100:00100000:0.0:1787790697.804644:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790697.804651:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268000256:12345-0@lo:13: 00002000:00000024:0.0:1787790697.804668:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790697.804831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.804890:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268000512:0@lo:13: 00000100:00100000:2.0:1787790697.804920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.804948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000128 00000100:00100000:2.0:1787790697.804952:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000128 00000100:00100000:2.0:1787790697.804978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787790697.804985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268000128:12345-0@lo:400: 00000100:00100000:2.0:1787790697.805021:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268000128:12345-0@lo:400: Request processed in 37us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790697.805027:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787790697.805057:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000512 00000100:00100000:2.0:1787790697.805060:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000512 00000100:00100000:2.0:1787790697.805078:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790697.805084:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268000512:12345-0@lo:13: 00002000:00000024:2.0:1787790697.805103:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790697.805130:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268000512:12345-0@lo:13: Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790697.805136:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787790697.805170:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb43c0 x1874634268000512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790697.805186:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268000512:0@lo:13: 00000100:00100000:2.0:1787790697.805196:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268000128:0@lo:400: 00000100:00080000:2.0:1787790697.805242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790697.810282:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268000768:0@lo:400: 00000100:00100000:1.0:1787790697.810357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790697.810395:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268001280:0@lo:400: 00000100:00100000:1.0:1787790697.810421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790697.810448:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787790697.810454:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3089e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268000896:0@lo:400: 00000100:00100000:1.0:1787790697.810496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790697.810516:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268001408:0@lo:400: 00000100:00100000:2.0:1787790697.811606:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268000640:0@lo:400: 00000100:00100000:2.0:1787790697.811655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.811685:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268001152:0@lo:400: 00000100:00100000:2.0:1787790697.811747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.811767:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268001664:0@lo:400: 00000100:00100000:2.0:1787790697.812459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.812507:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787790697.812515:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268001024:0@lo:400: 00000100:00100000:2.0:1787790697.812566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.812577:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268001536:0@lo:400: 00000100:00100000:2.0:1787790697.812691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790697.812870:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000768 00000100:00100000:2.0:1787790697.812878:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000768 00000100:00100000:2.0:1787790697.812980:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000640 00000100:00100000:2.0:1787790697.812984:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000640 00000100:00100000:2.0:1787790697.812997:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790697.813011:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268000768:12345-0@lo:400: 00000100:00100000:2.0:1787790697.813076:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268000768:12345-0@lo:400: Request processed in 65us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790697.813083:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790697.813101:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787790697.813107:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268000640:12345-0@lo:400: 00000100:00100000:2.0:1787790697.813138:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268000640:12345-0@lo:400: Request processed in 31us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790697.813144:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787790697.813161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268000896 00000100:00100000:2.0:1787790697.813164:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268000896 00000100:00100000:2.0:1787790697.813181:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001152 00000100:00100000:2.0:1787790697.813184:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001152 00000100:00100000:2.0:1787790697.813206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001664 00000100:00100000:2.0:1787790697.813209:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001664 00000100:00100000:2.0:1787790697.813223:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001024 00000100:00100000:2.0:1787790697.813226:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001024 00000100:00100000:2.0:1787790697.813235:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001536 00000100:00100000:2.0:1787790697.813237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001536 00000100:00100000:2.0:1787790697.813250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790697.813255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268000896:12345-0@lo:400: 00000100:00100000:2.0:1787790697.813287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268000896:12345-0@lo:400: Request processed in 31us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790697.813293:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790697.813302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790697.813308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268001152:12345-0@lo:400: 00010000:00080000:3.0:1787790697.814203:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f44780 x1874634268000256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790697.814222:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787790697.814598:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268000256:0@lo:13: 00000100:00100000:3.0:1787790697.814668:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001280 00000100:00100000:3.0:1787790697.814677:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001280 00000100:00100000:3.0:1787790697.814914:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790697.814928:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268001280:12345-0@lo:400: 00000100:00100000:0.0:1787790697.820238:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268000256:12345-0@lo:13: Request processed in 15576us (16802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790697.820255:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790697.821148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790697.821231:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268000768:0@lo:400: 00000100:00100000:1.0:1787790697.821265:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3089e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268000896:0@lo:400: 00000100:00100000:1.0:1787790697.821300:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790697.821308:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787790697.821528:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001408 00000100:00100000:1.0:1787790697.826210:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001408 00000100:00100000:1.0:1787790697.827726:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790697.827755:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790697.827772:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268001408:12345-0@lo:400: 00000100:00100000:1.0:1787790697.829017:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268001408:12345-0@lo:400: Request processed in 1246us (7866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790697.829034:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787790697.830969:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790697.830980:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790697.830984:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790697.831337:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268000640:0@lo:400: 00010000:00080000:1.0:1787790697.831364:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc308b0c0 x1874634268001408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790697.831380:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268001408:0@lo:400: 00000100:00100000:1.0:1787790697.831445:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790697.831455:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000001:00100000:0.0:1787790697.831732:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000001:00080000:0.0:1787790697.831745:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787790697.832083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787790697.832101:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268001664:12345-0@lo:400: 00000100:00100000:0.0:1787790697.832382:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790697.832544:0:10093:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787790697.832551:0:10093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787790697.832692:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787790697.832701:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268001024:12345-0@lo:400: 00000100:00100000:1.0:1787790697.836726:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268001664:12345-0@lo:400: Request processed in 4609us (24895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790697.836742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787790697.836784:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787790697.836830:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790697.836901:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268001536:12345-0@lo:400: 00000100:00100000:1.0:1787790697.837030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268001536:12345-0@lo:400: Request processed in 151us (24297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790697.837037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787790697.837098:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268001536:0@lo:400: 00010000:00080000:1.0:1787790697.837132:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f70c0 x1874634268001664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790697.837153:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268001664:0@lo:400: 00000100:00100000:0.0:1787790697.837558:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268001024:12345-0@lo:400: Request processed in 4856us (24988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790697.837568:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787790697.837619:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268001024:0@lo:400: 00000100:00100000:2.0:1787790697.842977:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268001152:12345-0@lo:400: Request processed in 29652us (31212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790697.842993:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268001280:12345-0@lo:400: Request processed in 28061us (32562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790697.843004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787790697.843013:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787790697.843168:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc308a580 x1874634268001280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790697.843184:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268001280:0@lo:400: 00010000:00080000:0.0:1787790697.849463:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc308a940 x1874634268001152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790697.849494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268001152:0@lo:400: 00010000:00010000:2.0:1787790698.315388:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790698.724613:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790698.724879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129024 00000100:00100000:1.0:1787790698.724893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129024 00000100:00080000:0.0:1787790698.725050:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790698.725194:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:1.0:1787790698.725220:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:6248:x1874634250129024:12345-192.168.202.22@tcp:41: 00000004:00000024:1.0:1787790698.725278:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787790698.725389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:6248:x1874634250129024:12345-192.168.202.22@tcp:41: Request processed in 173us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790698.725424:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:0.0:1787790698.738436:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790698.738567:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129152 00000100:00100000:2.0:1787790698.738579:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129152 00000100:00100000:2.0:1787790698.738876:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:2.0:1787790698.738888:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:6248:x1874634250129152:12345-192.168.202.22@tcp:41: 00000004:00000024:2.0:1787790698.738937:0:10093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790698.739028:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:6248:x1874634250129152:12345-192.168.202.22@tcp:41: Request processed in 144us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790698.739034:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00080000:0.0:1787790698.739342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790698.742354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790698.742482:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129280 00000100:00100000:2.0:1787790698.742494:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129280 00000100:00100000:2.0:1787790698.742631:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:2.0:1787790698.742645:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a61a333f-852a-40de-8207-4f7de209a9a4+6:6248:x1874634250129280:12345-192.168.202.22@tcp:13: 00002000:00000024:2.0:1787790698.742689:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790698.742815:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a61a333f-852a-40de-8207-4f7de209a9a4+6:6248:x1874634250129280:12345-192.168.202.22@tcp:13: Request processed in 172us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790698.742824:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790698.744548:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790698.744699:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129408 00000100:00100000:1.0:1787790698.744750:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129408 00000100:00080000:0.0:1787790698.747091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787790698.747115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790698.749420:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787790698.749445:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a61a333f-852a-40de-8207-4f7de209a9a4+5:6248:x1874634250129408:12345-192.168.202.22@tcp:13: 00002000:00000024:1.0:1787790698.749508:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790698.749876:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a61a333f-852a-40de-8207-4f7de209a9a4+5:6248:x1874634250129408:12345-192.168.202.22@tcp:13: Request processed in 439us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790698.749885:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00010000:00010000:2.0:1787790699.340803:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790700.364224:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268001792:0@lo:13: 00000100:00100000:1.0:1787790700.364342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790700.364543:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790700.365902:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001792 00000100:00100000:0.0:1787790700.365921:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001792 00000100:00100000:0.0:1787790700.366035:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790700.366054:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268001792:12345-0@lo:13: 00002000:00000024:0.0:1787790700.366102:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787790700.366231:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790700.367468:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268001920:0@lo:13: 00000100:00100000:2.0:1787790700.367550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790700.367659:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268001920 00000100:00100000:2.0:1787790700.367667:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268001920 00000100:00100000:2.0:1787790700.367754:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787790700.367765:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268001920:12345-0@lo:13: 00002000:00000024:2.0:1787790700.367788:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790700.367853:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268001920:12345-0@lo:13: Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790700.367861:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787790700.367890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790700.367923:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f46940 x1874634268001920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790700.367945:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268001920:0@lo:13: 00000100:00100000:0.0:1787790700.372238:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268001792:12345-0@lo:13: Request processed in 6174us (7878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790700.372260:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787790700.375429:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd2d00 x1874634268001792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790700.375481:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268001792:0@lo:13: 00000001:00100000:3.0:1787790700.876665:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000001:00100000:3.0:1787790700.877490:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00010000:00010000:2.0:1787790701.386835:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790701.387095:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790701.387117:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268002048:0@lo:41: 00000100:00100000:2.0:1787790701.387203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790701.387288:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002048 00000100:00100000:2.0:1787790701.387296:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002048 00000100:00100000:2.0:1787790701.387346:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790701.387355:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268002048:12345-0@lo:41: 00000004:00000024:2.0:1787790701.387533:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790701.387581:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268002048:12345-0@lo:41: Request processed in 227us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790701.387588:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790701.387646:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268002048:0@lo:41: 00000100:00100000:3.0:1787790701.391745:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268002176:0@lo:41: 00000100:00100000:3.0:1787790701.391824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790701.391866:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002176 00000100:00100000:1.0:1787790701.391874:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002176 00000100:00100000:1.0:1787790701.391924:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790701.391933:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268002176:12345-0@lo:41: 00000004:00000024:1.0:1787790701.391966:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787790701.392021:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268002176:12345-0@lo:41: Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790701.392028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787790701.395754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268002176:0@lo:41: 00000001:02000400:0.0:1787790701.401567:0:10180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787790701.512189:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790701.512273:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790701.512315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790701.512339:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790701.512377:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129920 00000100:00100000:3.0:1787790701.512387:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129920 00000100:00100000:3.0:1787790701.512464:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787790701.512475:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250129920:12345-192.168.202.22@tcp:400: 00000100:00100000:3.0:1787790701.512552:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250129920:12345-192.168.202.22@tcp:400: Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790701.512560:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00080000:3.0:1787790701.512595:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790701.520453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129536 00000100:00100000:0.0:1787790701.520479:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129536 00000100:00100000:0.0:1787790701.520542:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 196 00000100:00100000:0.0:1787790701.520555:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250129536:12345-192.168.202.22@tcp:400: 00000100:00100000:0.0:1787790701.520666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250129536:12345-192.168.202.22@tcp:400: Request processed in 113us (8349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790701.520673:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 196 00000100:00100000:0.0:1787790701.521132:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790701.521158:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130048 00000100:00100000:0.0:1787790701.521162:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130048 00000100:00100000:0.0:1787790701.521197:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:0.0:1787790701.521205:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250130048:12345-192.168.202.22@tcp:400: 00000100:00100000:0.0:1787790701.521236:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250130048:12345-192.168.202.22@tcp:400: Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790701.521243:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:2.0:1787790701.525504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129664 00000100:00100000:2.0:1787790701.525520:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129664 00000100:00100000:2.0:1787790701.525925:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250129792 00000100:00100000:2.0:1787790701.525930:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250129792 00000100:00100000:2.0:1787790701.525963:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:2.0:1787790701.525973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250129664:12345-192.168.202.22@tcp:400: 00000100:00100000:2.0:1787790701.526060:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250129664:12345-192.168.202.22@tcp:400: Request processed in 88us (13883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790701.526074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:2.0:1787790701.526092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:2.0:1787790701.526098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250129792:12345-192.168.202.22@tcp:400: 00000100:00100000:2.0:1787790701.526137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250129792:12345-192.168.202.22@tcp:400: Request processed in 39us (13798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790701.526143:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00080000:1.0:1787790701.528771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790701.528781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790701.528784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787790701.905918:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00010000:00010000:2.0:1787790702.418135:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790702.922991:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268002432:0@lo:13: 00000100:00100000:0.0:1787790702.923067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790702.923130:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790702.923137:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268002304:0@lo:13: 00000100:00100000:0.0:1787790702.923161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790702.923193:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002432 00000100:00100000:0.0:1787790702.923199:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002432 00000100:00100000:0.0:1787790702.924918:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002304 00000100:00100000:0.0:1787790702.924930:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002304 00000100:00100000:0.0:1787790702.924958:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790702.924969:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268002432:12345-0@lo:13: 00002000:00000024:0.0:1787790702.925003:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787790702.925070:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790702.925080:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268002432:12345-0@lo:13: Request processed in 112us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790702.925095:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787790702.925103:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787790702.925116:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268002304:12345-0@lo:13: 00002000:00000024:3.0:1787790702.925127:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787790702.925632:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371e940 x1874634268002432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790702.925656:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268002432:0@lo:13: 00000100:00100000:1.0:1787790702.926001:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268002560:0@lo:400: 00000100:00100000:0.0:1787790702.928698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268002688:0@lo:400: 00000100:00100000:3.0:1787790702.931930:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268002304:12345-0@lo:13: Request processed in 6806us (8758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790702.931945:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787790702.932040:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268002816:0@lo:400: 00000100:00100000:2.0:1787790702.932087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.932126:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268003328:0@lo:400: 00000100:00100000:2.0:1787790702.932151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790702.932169:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002816 00000100:00100000:2.0:1787790702.932169:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268003840:0@lo:400: 00000100:00100000:3.0:1787790702.932176:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002816 00000100:00100000:2.0:1787790702.932189:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.932207:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790702.932214:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787790702.932214:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268002944:0@lo:400: 00000100:00100000:3.0:1787790702.932221:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268002816:12345-0@lo:400: 00000100:00100000:2.0:1787790702.932234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.932249:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268003456:0@lo:400: 00000100:00100000:3.0:1787790702.932266:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268002816:12345-0@lo:400: Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.932270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790702.932273:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787790702.932283:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002944 00000100:00100000:3.0:1787790702.932286:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002944 00000100:00100000:3.0:1787790702.932299:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787790702.932300:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268002816:0@lo:400: 00000100:00100000:3.0:1787790702.932304:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268002944:12345-0@lo:400: 00000100:00100000:2.0:1787790702.932327:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003328 00000100:00100000:2.0:1787790702.932330:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003328 00000100:00100000:3.0:1787790702.932335:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268002944:12345-0@lo:400: Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790702.932341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787790702.932359:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003456 00000100:00100000:2.0:1787790702.932360:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003840 00000100:00100000:3.0:1787790702.932362:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003456 00000100:00100000:2.0:1787790702.932363:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003840 00000100:00100000:2.0:1787790702.932379:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787790702.932385:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268003328:12345-0@lo:400: 00000100:00100000:2.0:1787790702.932442:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268003328:12345-0@lo:400: Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.932449:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787790702.932463:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790702.932469:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268003840:12345-0@lo:400: 00000100:00100000:2.0:1787790702.932496:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268003840:12345-0@lo:400: Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.932500:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790702.933015:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268002944:0@lo:400: 00010000:00080000:2.0:1787790702.933029:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371c3c0 x1874634268003328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790702.933039:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268003328:0@lo:400: 00010000:00080000:2.0:1787790702.933050:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bda40 x1874634268003840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790702.933056:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268003840:0@lo:400: 00000100:00080000:2.0:1787790702.933089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790702.933094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787790702.933130:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371e580 x1874634268002304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790702.933138:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787790702.933157:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268002304:0@lo:13: 00000100:00100000:3.0:1787790702.933901:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790702.933914:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268003456:12345-0@lo:400: 00000100:00100000:1.0:1787790702.933956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790702.933987:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002560 00000100:00100000:1.0:1787790702.933993:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002560 00000100:00100000:1.0:1787790702.934024:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787790702.934031:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268002560:12345-0@lo:400: 00000100:00100000:3.0:1787790702.934045:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268003456:12345-0@lo:400: Request processed in 136us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790702.934052:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790702.934059:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268002560:12345-0@lo:400: Request processed in 31us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790702.934065:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:3.0:1787790702.934088:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371c780 x1874634268003456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790702.934103:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268002560:0@lo:400: 00000100:00100000:3.0:1787790702.934111:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268003456:0@lo:400: 00000100:00100000:1.0:1787790702.934123:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268003072:0@lo:400: 00000100:00100000:1.0:1787790702.934149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790702.934183:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268003584:0@lo:400: 00000100:00100000:1.0:1787790702.934205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.934462:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003584 00000100:00100000:2.0:1787790702.934467:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003584 00000100:00100000:3.0:1787790702.934484:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003072 00000100:00100000:3.0:1787790702.934488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003072 00000100:00100000:2.0:1787790702.934499:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790702.934505:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268003584:12345-0@lo:400: 00000100:00100000:3.0:1787790702.934511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787790702.934516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268003072:12345-0@lo:400: 00000100:00100000:3.0:1787790702.934560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268003072:12345-0@lo:400: Request processed in 42us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790702.934566:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787790702.934591:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790702.934626:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268003584:12345-0@lo:400: Request processed in 120us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.934633:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790702.934941:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268003072:0@lo:400: 00010000:00080000:1.0:1787790702.934954:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371f840 x1874634268003584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790702.934963:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268003584:0@lo:400: 00000100:00100000:2.0:1787790702.935296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.935321:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268003200:0@lo:400: 00000100:00100000:2.0:1787790702.935342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.935370:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268003712:0@lo:400: 00000100:00100000:2.0:1787790702.935390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790702.935411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268002688 00000100:00100000:2.0:1787790702.935416:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268002688 00000100:00100000:2.0:1787790702.935452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003200 00000100:00100000:2.0:1787790702.935455:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003200 00000100:00100000:2.0:1787790702.935473:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268003712 00000100:00100000:2.0:1787790702.935476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268003712 00000100:00100000:2.0:1787790702.935490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790702.935496:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268002688:12345-0@lo:400: 00000100:00100000:2.0:1787790702.935533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268002688:12345-0@lo:400: Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.935551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790702.935565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787790702.935570:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268003200:12345-0@lo:400: 00000100:00100000:2.0:1787790702.935598:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268003200:12345-0@lo:400: Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.935603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787790702.935614:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790702.935620:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268003712:12345-0@lo:400: 00000100:00100000:2.0:1787790702.935645:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268003712:12345-0@lo:400: Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790702.935662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790702.935689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268003712:0@lo:400: 00000100:00080000:3.0:1787790702.935856:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790702.935863:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268002688:0@lo:400: 00000100:00100000:2.0:1787790702.935876:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268003200:0@lo:400: 00010000:00010000:1.0:1787790703.438284:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790704.461674:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787790704.909773:0:10327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5c1475f0 20000000:00000080:1.0:1787790704.909790:0:10327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff916fc37ad400 uarg=0000000000000000 20000000:01000000:1.0:1787790704.909831:0:10327:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787790704.909833:0:10327:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787790704.909836:0:10327:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787790704.909841:0:10327:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787790704.909847:0:10327:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787790704.909916:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787790704.909919:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787790704.910547:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1787790704.910853:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1787790704.910895:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1787790704.910909:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1787790704.910918:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787790704.910920:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787790704.912626:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787790704.912998:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787790704.913028:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787790704.913045:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787790704.913057:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787790704.913060:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787790704.913919:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1787790704.914107:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1787790704.914131:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1787790704.914146:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1787790704.914156:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787790704.914159:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787790704.914856:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1787790704.915435:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1787790704.915464:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1787790704.915480:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1787790704.915492:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787790704.915494:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787790704.915921:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1787790704.916089:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1787790704.916472:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1787790704.916514:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:1.0:1787790704.916531:0:10327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787790704.916553:0:10327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916570:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916578:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916592:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916598:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916605:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916610:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916616:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916622:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916629:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916638:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916644:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916651:0:10327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916702:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.916998:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 9 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.917013:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268003968:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790704.917184:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917194:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 9 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.917204:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004096:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790704.917250:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917258:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 23 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.917268:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004224:0@lo:104: 00000100:00100000:1.0:1787790704.917327:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790704.917364:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917373:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 23 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.917393:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004352:0@lo:104: 00000100:00100000:1.0:1787790704.917425:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790704.917456:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917465:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 23 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.917473:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004480:0@lo:104: 00000100:00100000:1.0:1787790704.917494:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.917529:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004224 00000100:00100000:1.0:1787790704.917536:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004224 00000100:00100000:1.0:1787790704.917572:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004352 00000100:00100000:1.0:1787790704.917576:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004352 00000100:00100000:1.0:1787790704.917585:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004480 00000100:00100000:1.0:1787790704.917587:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004480 00000100:00100000:1.0:1787790704.917599:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790704.917607:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+5:10327:x1874634268004224:12345-0@lo:104: 00010000:00010000:1.0:1787790704.917620:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917666:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790704.917671:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+5:10327:x1874634268004224:12345-0@lo:104: Request processed in 65us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.917678:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790704.917696:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790704.917701:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:10327:x1874634268004352:12345-0@lo:104: 00010000:00010000:1.0:1787790704.917747:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917782:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787790704.917788:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:10327:x1874634268004352:12345-0@lo:104: Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.917794:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790704.917808:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790704.917814:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268004480:12345-0@lo:104: 00010000:00010000:1.0:1787790704.917820:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917850:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787790704.917856:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268004480:12345-0@lo:104: Request processed in 42us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.917861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787790704.917877:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787790704.917883:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917890:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.917894:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917903:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.917910:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.917921:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.917951:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917958:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790704.917974:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917982:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1d9a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d9a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.917993:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790704.917996:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918002:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fc00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.918005:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918012:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.918018:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.918023:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.918036:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918042:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790704.918062:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918068:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fc00/0xcf9477fddcf1d97f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918078:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790704.918081:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918087:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.918089:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918095:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.918101:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.918105:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.918119:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918124:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790704.918129:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918135:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38c00/0xcf9477fddcf1d963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d96a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918144:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918153:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790704.918165:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268004736:0@lo:103: 00000100:00100000:1.0:1787790704.918197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.918223:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790704.918228:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268004864:0@lo:103: 00000100:00100000:1.0:1787790704.918249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790704.918283:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918292:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 23 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.918301:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004992:0@lo:104: 00000100:00100000:1.0:1787790704.918337:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.918365:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787790704.918374:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004992 00000100:00100000:1.0:1787790704.918378:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004992 00000100:00100000:1.0:1787790704.918396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787790704.918402:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3eaec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268004992:12345-0@lo:104: 00010000:00010000:1.0:1787790704.918423:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918455:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790704.918460:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3eaec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268004992:12345-0@lo:104: Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.918466:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787790704.918497:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790704.918501:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918513:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fe00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.918516:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918523:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.918530:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.918535:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.918549:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918556:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790704.918562:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918569:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fe00/0xcf9477fddcf1d939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d940 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918577:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918579:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918581:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918599:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918607:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 23 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.918627:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268005248:0@lo:104: 00000100:00100000:1.0:1787790704.918650:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.918670:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005248 00000100:00100000:1.0:1787790704.918674:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005248 00000100:00100000:1.0:1787790704.918692:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790704.918697:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3089e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268005248:12345-0@lo:104: 00010000:00010000:1.0:1787790704.918728:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918767:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790704.918773:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3089e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268005248:12345-0@lo:104: Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.918779:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787790704.918793:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790704.918797:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918803:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.918806:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918813:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.918819:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.918824:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.918846:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918852:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790704.918857:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918862:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1d91d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d924 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918873:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918875:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.918897:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.918904:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 23 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.918912:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268005504:0@lo:104: 00000100:00100000:1.0:1787790704.918934:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.918952:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005504 00000100:00100000:1.0:1787790704.918955:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005504 00000100:00100000:1.0:1787790704.918972:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790704.918977:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268005504:12345-0@lo:104: 00010000:00010000:1.0:1787790704.918983:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919013:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790704.919018:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268005504:12345-0@lo:104: Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.919030:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787790704.919044:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790704.919047:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919054:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.919057:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919064:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.919070:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.919075:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.919089:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919094:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790704.919104:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919110:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1600/0xcf9477fddcf1d90f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d916 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919119:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.919121:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.919123:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790704.919134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268005632:0@lo:103: 00000100:00100000:1.0:1787790704.919163:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790704.919202:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919211:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 23 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.919218:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268005760:0@lo:104: 00000100:00100000:1.0:1787790704.919239:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.919258:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005760 00000100:00100000:1.0:1787790704.919261:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005760 00000100:00100000:1.0:1787790704.919277:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790704.919282:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268005760:12345-0@lo:104: 00010000:00010000:1.0:1787790704.919289:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919317:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790704.919321:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268005760:12345-0@lo:104: Request processed in 40us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.919327:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787790704.919338:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790704.919342:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919349:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790704.919351:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919357:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790704.919369:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790704.919374:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790704.919398:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.919403:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787790704.919551:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268005120:0@lo:103: 00000100:00100000:3.0:1787790704.919583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790704.919607:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790704.919613:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268004608:0@lo:103: 00000100:00100000:3.0:1787790704.919633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790704.919643:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268005376:0@lo:103: 00000100:00100000:3.0:1787790704.919659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790704.919677:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004736 00000100:00100000:3.0:1787790704.919680:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004736 00010000:00010000:3.0:1787790704.919700:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 24 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.919730:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004864 00000100:00100000:3.0:1787790704.919739:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004864 00010000:00010000:3.0:1787790704.919753:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 25 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.919766:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005632 00000100:00100000:3.0:1787790704.919769:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005632 00010000:00010000:3.0:1787790704.919778:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 26 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.919787:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005120 00000100:00100000:3.0:1787790704.919790:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005120 00010000:00010000:3.0:1787790704.919799:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 27 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.919809:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268004608 00000100:00100000:3.0:1787790704.919811:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268004608 00010000:00010000:3.0:1787790704.919821:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 28 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.919830:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005376 00000100:00100000:3.0:1787790704.919832:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005376 00010000:00010000:3.0:1787790704.919842:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 29 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.919853:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790704.919860:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4789050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+29:3640:x1874634268004736:12345-0@lo:103: 00010000:00010000:3.0:1787790704.919870:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.919875:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 29 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.919885:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 29 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.919912:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.919945:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4789050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+29:3640:x1874634268004736:12345-0@lo:103: Request processed in 85us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.919951:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790704.919990:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790704.919996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+28:3640:x1874634268004864:12345-0@lo:103: 00010000:00010000:3.0:1787790704.920003:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.920007:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 28 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920015:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 28 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920024:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.920045:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+28:3640:x1874634268004864:12345-0@lo:103: Request processed in 50us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.920051:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790704.920063:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790704.920069:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+27:3640:x1874634268005632:12345-0@lo:103: 00010000:00010000:3.0:1787790704.920075:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.920079:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 27 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920087:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 27 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920097:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.920126:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+27:3640:x1874634268005632:12345-0@lo:103: Request processed in 57us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.920131:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790704.920143:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790704.920149:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+26:3638:x1874634268005120:12345-0@lo:103: 00010000:00010000:3.0:1787790704.920156:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.920160:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 26 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920167:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 26 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920177:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.920202:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+26:3638:x1874634268005120:12345-0@lo:103: Request processed in 54us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.920208:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787790704.920219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787790704.920225:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+25:3638:x1874634268004608:12345-0@lo:103: 00010000:00010000:3.0:1787790704.920231:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.920235:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 25 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920243:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 25 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920252:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.920271:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+25:3638:x1874634268004608:12345-0@lo:103: Request processed in 47us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.920276:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787790704.920295:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787790704.920301:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268005376:12345-0@lo:103: 00010000:00010000:3.0:1787790704.920308:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.920330:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 24 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920338:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 24 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.920348:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.920370:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268005376:12345-0@lo:103: Request processed in 70us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.920376:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787790704.920436:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268005632:0@lo:103: 00000100:00100000:3.0:1787790704.920446:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268004864:0@lo:103: 00000100:00100000:3.0:1787790704.920453:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268004736:0@lo:103: 00000100:00100000:3.0:1787790704.920484:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268004608:0@lo:103: 00000100:00100000:3.0:1787790704.920490:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268005376:0@lo:103: 00000100:00100000:3.0:1787790704.920495:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268005120:0@lo:103: 00010000:00010000:2.0:1787790704.920640:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790704.920799:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.921473:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.921484:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1d901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d908 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.921498:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.921500:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.921501:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790704.921544:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.921556:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 23 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921565:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268006016:0@lo:104: 00000100:00100000:1.0:1787790704.921604:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.921630:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006016 00000100:00100000:1.0:1787790704.921635:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006016 00000100:00100000:1.0:1787790704.921667:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790704.921674:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268006016:12345-0@lo:104: 00010000:00010000:1.0:1787790704.921695:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.921755:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790704.921760:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268006016:12345-0@lo:104: Request processed in 87us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790704.921767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787790704.921802:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790704.921811:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 23 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921820:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268006144:0@lo:104: 00000100:00100000:1.0:1787790704.921839:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790704.921856:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2684600 going to sleep for 11 seconds 00010000:00010000:1.0:1787790704.921871:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38e00/0xcf9477fddcf1d9a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d9a2 expref: 23 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921881:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004224:0@lo:104: 00010000:00010000:1.0:1787790704.921890:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38600/0xcf9477fddcf1d986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d97f expref: 22 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921898:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004352:0@lo:104: 00010000:00010000:1.0:1787790704.921906:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9f600/0xcf9477fddcf1d96a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d963 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921913:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004480:0@lo:104: 00010000:00010000:1.0:1787790704.921921:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1d940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d939 expref: 20 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921934:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004992:0@lo:104: 00010000:00010000:1.0:1787790704.921944:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1d924 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d91d expref: 19 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921951:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268005248:0@lo:104: 00010000:00010000:1.0:1787790704.921959:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9ee00/0xcf9477fddcf1d916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d90f expref: 18 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.921966:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268005504:0@lo:104: 00000100:00100000:1.0:1787790704.921972:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268005760:0@lo:104: 00000100:00100000:1.0:1787790704.921977:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268006016:0@lo:104: 00000100:00100000:3.0:1787790704.922038:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268005888:0@lo:103: 00000100:00100000:3.0:1787790704.922064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790704.922098:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006144 00000100:00100000:3.0:1787790704.922101:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006144 00000100:00100000:3.0:1787790704.922121:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790704.922126:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268006144:12345-0@lo:104: 00010000:00010000:3.0:1787790704.922139:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922181:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787790704.922186:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:10327:x1874634268006144:12345-0@lo:104: Request processed in 60us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.922192:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787790704.922205:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790704.922210:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922217:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd39200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790704.922229:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922237:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790704.922244:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790704.922250:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790704.922274:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922287:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790704.922300:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922306:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1d8c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d8c9 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922328:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790704.922331:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922337:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790704.922340:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922347:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790704.922353:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790704.922358:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790704.922370:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922375:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790704.922380:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922386:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1d898 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d89f expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922397:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790704.922399:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790704.922400:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790704.922425:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268006400:0@lo:103: 00000100:00100000:3.0:1787790704.922454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790704.922475:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790704.922480:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268006272:0@lo:103: 00000100:00100000:3.0:1787790704.922496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790704.922837:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268005888 00000100:00100000:3.0:1787790704.922841:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268005888 00010000:00010000:3.0:1787790704.922859:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 18 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.922876:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006400 00000100:00100000:3.0:1787790704.922879:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006400 00010000:00010000:3.0:1787790704.922887:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 19 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.922896:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006272 00000100:00100000:3.0:1787790704.922898:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006272 00010000:00010000:3.0:1787790704.922905:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 20 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.922915:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790704.922921:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+20:3641:x1874634268005888:12345-0@lo:103: 00010000:00010000:3.0:1787790704.922929:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.922934:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 20 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922942:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 20 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922955:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1d908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d901 expref: 20 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.922977:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.923005:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+19:3641:x1874634268005888:12345-0@lo:103: Request processed in 84us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.923011:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787790704.923022:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787790704.923028:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c6460c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+18:3639:x1874634268006400:12345-0@lo:103: 00010000:00010000:3.0:1787790704.923034:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.923038:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 18 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.923046:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 18 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.923054:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.923073:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c6460c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+18:3639:x1874634268006400:12345-0@lo:103: Request processed in 46us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.923078:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787790704.923109:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790704.923114:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+17:3639:x1874634268006272:12345-0@lo:103: 00010000:00010000:3.0:1787790704.923119:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.923123:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 17 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.923130:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 17 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.923139:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1d8c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d8c2 expref: 17 pid: 6507 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.923152:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.923170:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+16:3639:x1874634268006272:12345-0@lo:103: Request processed in 56us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.923175:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790704.923204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268005888:0@lo:103: 00000100:00100000:3.0:1787790704.923439:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268006272:0@lo:103: 00000100:00100000:3.0:1787790704.923446:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268006400:0@lo:103: 00010000:00010000:1.0:1787790704.924161:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1d89f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d898 expref: 15 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790704.924184:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268006144:0@lo:104: 00010000:00010000:3.0:1787790704.924698:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790704.925038:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790704.925077:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790704.925105:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130176 00000100:00100000:0.0:1787790704.925111:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130176 00010000:00010000:0.0:1787790704.925142:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 10 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790704.925183:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130304 00000100:00100000:0.0:1787790704.925186:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130304 00010000:00010000:0.0:1787790704.925198:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 11 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790704.925215:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:1.0:1787790704.925536:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268003968:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790704.925547:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1874634268004096:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790704.925589:0:10327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790704.925737:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:3.0:1787790704.925749:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:2403:x1874634250130304:12345-192.168.202.22@tcp:103: 00010000:00010000:3.0:1787790704.925764:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790704.925769:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 11 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.925780:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 11 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.925797:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1d9be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a24 expref: 11 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.925811:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790704.925869:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250130304:12345-192.168.202.22@tcp:103: Request processed in 123us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790704.925876:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:0.0:1787790704.925944:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:2403:x1874634250130176:12345-192.168.202.22@tcp:103: 00010000:00010000:0.0:1787790704.925953:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790704.925958:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 9 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.925966:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 9 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.925998:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1d9c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a2b expref: 9 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926009:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926017:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926033:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926040:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926046:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926053:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926059:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790704.926062:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926071:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926094:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790704.926114:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790704.926135:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:2403:x1874634250130176:12345-192.168.202.22@tcp:103: Request processed in 912us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790704.926142:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00010000:00010000:3.0:1787790704.926598:0:10327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.926613:0:10327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790704.926619:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da04 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790705.482930:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268006528:0@lo:13: 00000100:00100000:0.0:1787790705.483012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790705.483081:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790705.483088:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268006656:0@lo:13: 00000100:00100000:0.0:1787790705.483112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790705.483259:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006528 00000100:00100000:2.0:1787790705.483268:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006528 00000100:00100000:3.0:1787790705.483284:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006656 00000100:00100000:3.0:1787790705.483291:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006656 00000100:00100000:2.0:1787790705.483470:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787790705.483481:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268006528:12345-0@lo:13: 00002000:00000024:2.0:1787790705.483511:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790705.483559:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268006528:12345-0@lo:13: Request processed in 80us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790705.483566:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787790705.483747:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787790705.485534:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37e3840 x1874634268006528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790705.485562:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268006528:0@lo:13: 00000100:00100000:3.0:1787790705.485666:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790705.485680:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268006656:12345-0@lo:13: 00002000:00000024:3.0:1787790705.485720:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790705.485803:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268006656:12345-0@lo:13: Request processed in 128us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790705.485810:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787790705.486140:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3088000 x1874634268006656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790705.486170:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268006656:0@lo:13: 00000100:00080000:0.0:1787790705.489029:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1787790706.059230:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787790706.059236:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f67a4800 from 48 10000000:01000000:3.0:1787790706.059240:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790706.059886:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.059900:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.059913:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.059943:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268006784:0@lo:101: 00000100:00100000:3.0:1787790706.060031:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.060555:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.066573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006784 00000100:00100000:2.0:1787790706.066588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006784 00000100:00100000:2.0:1787790706.066649:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787790706.066659:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+15:6509:x1874634268006784:12345-0@lo:101: 00010000:00010000:2.0:1787790706.066675:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790706.066696:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1da12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da0b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.066738:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1da12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da0b expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.066749:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1da12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da0b expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.066771:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39600, rc 0) 00000100:00100000:2.0:1787790706.067186:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634268006784:12345-0@lo:101: Request processed in 525us (7152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.067193:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787790706.069026:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268006784:0@lo:101: 00010000:00010000:3.0:1787790706.069058:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.069069:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.069161:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268006912:0@lo:501: 00000100:00100000:3.0:1787790706.069217:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.069266:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.069348:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268006912 00000100:00100000:2.0:1787790706.069354:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268006912 00000100:00100000:2.0:1787790706.069422:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787790706.069433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634268006912:12345-0@lo:501: 00000100:00100000:2.0:1787790706.069588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634268006912:12345-0@lo:501: Request processed in 156us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.069595:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787790706.069774:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268006912:0@lo:501: 00000100:00100000:3.0:1787790706.069803:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007040:0@lo:503: 00000100:00100000:3.0:1787790706.069846:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.069875:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.069937:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007040 00000100:00100000:1.0:1787790706.069942:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007040 00000100:00100000:1.0:1787790706.069977:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787790706.069984:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634268007040:12345-0@lo:503: 00000100:00100000:1.0:1787790706.070076:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634268007040:12345-0@lo:503: Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.070083:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787790706.070319:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007040:0@lo:503: 00000100:00100000:0.0:1787790706.070794:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10345:1874634268007168:0@lo:502: 00000100:00100000:0.0:1787790706.070835:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790706.070867:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.070908:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007168 00000100:00100000:2.0:1787790706.070913:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007168 00000100:00100000:2.0:1787790706.070946:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787790706.070954:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:10345:x1874634268007168:12345-0@lo:502: 00000100:00100000:2.0:1787790706.071044:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+16:10345:x1874634268007168:12345-0@lo:502: Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.071051:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787790706.071123:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10345:1874634268007168:0@lo:502: 00000100:00100000:0.0:1787790706.071154:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10345:1874634268007296:0@lo:502: 00000100:00100000:0.0:1787790706.071184:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790706.071205:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790706.071304:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007296 00000100:00100000:3.0:1787790706.071308:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007296 00000100:00100000:3.0:1787790706.071337:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787790706.071344:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:10345:x1874634268007296:12345-0@lo:502: 00000100:00100000:3.0:1787790706.071419:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:10345:x1874634268007296:12345-0@lo:502: Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790706.071427:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787790706.071496:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10345:1874634268007296:0@lo:502: 00000040:00080000:0.0:1787790706.071513:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787790706.071732:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787790706.071749:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790706.071759:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.071775:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790706.071786:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787790706.071788:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787790706.071792:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787790706.071814:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.071822:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.071831:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.071841:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007424:0@lo:101: 00000100:00100000:3.0:1787790706.071866:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.071887:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.071948:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007424 00000100:00100000:0.0:1787790706.071952:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007424 00000100:00100000:0.0:1787790706.071971:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787790706.071976:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+16:6509:x1874634268007424:12345-0@lo:101: 00010000:00010000:0.0:1787790706.071984:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790706.072000:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0031800/0xcf9477fddcf1da20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da19 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.072021:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031800/0xcf9477fddcf1da20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da19 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.072031:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0031800/0xcf9477fddcf1da20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da19 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.072040:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031800, rc 0) 00000100:00100000:0.0:1787790706.072063:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634268007424:12345-0@lo:101: Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.072069:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787790706.072196:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007424:0@lo:101: 00010000:00010000:3.0:1787790706.072208:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.072217:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.072258:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007552:0@lo:501: 00000100:00100000:3.0:1787790706.072279:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.072303:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.072356:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007552 00000100:00100000:2.0:1787790706.072360:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007552 00000100:00100000:2.0:1787790706.072386:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787790706.072393:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634268007552:12345-0@lo:501: 00000100:00100000:2.0:1787790706.072483:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634268007552:12345-0@lo:501: Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.072489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787790706.072566:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007552:0@lo:501: 00000100:00100000:3.0:1787790706.072588:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007680:0@lo:503: 00000100:00100000:3.0:1787790706.072616:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.072634:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.072728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007680 00000100:00100000:2.0:1787790706.072732:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007680 00000100:00100000:2.0:1787790706.072756:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787790706.072761:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634268007680:12345-0@lo:503: 00000100:00100000:2.0:1787790706.072818:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634268007680:12345-0@lo:503: Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.072824:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787790706.072895:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268007680:0@lo:503: 00000100:00100000:3.0:1787790706.073495:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10346:1874634268007808:0@lo:502: 00000100:00100000:3.0:1787790706.073529:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.073562:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.073782:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007808 00000100:00100000:2.0:1787790706.073787:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007808 00000100:00100000:2.0:1787790706.073816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787790706.073823:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:10346:x1874634268007808:12345-0@lo:502: 00000100:00100000:2.0:1787790706.073910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+17:10346:x1874634268007808:12345-0@lo:502: Request processed in 87us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.073917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787790706.074024:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10346:1874634268007808:0@lo:502: 00000020:01000000:0.0:1787790706.074048:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790706.074056:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790706.074057:0:10346:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787790706.074063:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787790706.074086:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10346:1874634268007936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790706.074316:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790706.074344:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.074392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268007936 00000100:00100000:1.0:1787790706.074406:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268007936 00000100:00100000:1.0:1787790706.074439:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787790706.074447:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:10346:x1874634268007936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.074526:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:10346:x1874634268007936:12345-0@lo:502:llog_process_th.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.074533:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787790706.074793:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10346:1874634268007936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790706.074816:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790706.074820:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790706.074822:0:10346:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787790706.074826:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787790706.074972:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787790706.074998:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787790706.075007:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.075016:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790706.075025:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790706.075028:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3c78800 from 48 10000000:01000000:2.0:1787790706.075031:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790706.075055:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.075063:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.075080:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790706.075170:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.075204:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.075224:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.075278:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008064 00000100:00100000:1.0:1787790706.075283:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008064 00000100:00100000:1.0:1787790706.075313:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787790706.075320:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+17:6509:x1874634268008064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790706.075329:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790706.075342:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c29e1600/0xcf9477fddcf1da2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da27 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.075363:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e1600/0xcf9477fddcf1da2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da27 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.075385:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c29e1600/0xcf9477fddcf1da2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da27 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.075393:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e1600, rc 0) 00000100:00100000:1.0:1787790706.075435:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634268008064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.075441:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787790706.075537:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790706.075613:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.075623:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790706.075667:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.075688:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.075729:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.075967:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008192 00000100:00100000:0.0:1787790706.075971:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008192 00000100:00100000:0.0:1787790706.075994:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787790706.076007:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634268008192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790706.076142:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634268008192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.076148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787790706.076269:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.076298:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.076335:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.076364:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.076426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008320 00000100:00100000:1.0:1787790706.076430:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008320 00000100:00100000:1.0:1787790706.076462:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787790706.076470:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634268008320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.076554:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634268008320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.076561:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787790706.076738:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.081133:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10347:1874634268008448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.081212:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790706.081286:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2684000 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.086230:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008448 00000100:00100000:2.0:1787790706.086245:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008448 00000100:00100000:2.0:1787790706.086409:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787790706.086421:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:10347:x1874634268008448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790706.086630:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+18:10347:x1874634268008448:12345-0@lo:502:llog_process_th.0 Request processed in 212us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.086638:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787790706.086753:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10347:1874634268008448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.086817:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10347:1874634268008576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.086858:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790706.094469:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2684000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790706.106958:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008576 00000100:00100000:3.0:1787790706.106980:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008576 00000100:00100000:3.0:1787790706.107052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787790706.107064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:10347:x1874634268008576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.107233:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:10347:x1874634268008576:12345-0@lo:502:llog_process_th.0 Request processed in 170us (20373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790706.107241:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787790706.107356:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10347:1874634268008576:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787790706.107407:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787790706.109767:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787790706.109802:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787790706.109815:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.109828:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790706.109839:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787790706.109841:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787790706.109845:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790706.109903:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.109911:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.109923:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.109949:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.110022:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.110076:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.110139:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008704 00000100:00100000:2.0:1787790706.110147:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008704 00000100:00100000:2.0:1787790706.110197:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787790706.110207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+18:6509:x1874634268008704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790706.110222:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790706.110236:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1da3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da35 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.110263:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1da3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da35 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.110274:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1da3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da35 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.110283:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39800, rc 0) 00000100:00100000:2.0:1787790706.110329:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634268008704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.110336:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787790706.110512:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790706.110526:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.110535:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.110604:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.110629:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.110652:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.110807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008832 00000100:00100000:2.0:1787790706.110812:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008832 00000100:00100000:2.0:1787790706.110845:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787790706.110853:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634268008832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.110979:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634268008832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.110998:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787790706.111108:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.111140:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.111179:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.111207:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.111252:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268008960 00000100:00100000:2.0:1787790706.111256:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268008960 00000100:00100000:2.0:1787790706.111285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787790706.111291:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634268008960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.111372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634268008960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.111379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787790706.111485:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268008960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.114686:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10348:1874634268009088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.114796:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.114828:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.114979:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009088 00000100:00100000:2.0:1787790706.114986:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009088 00000100:00100000:2.0:1787790706.115035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787790706.115043:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:10348:x1874634268009088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790706.115174:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:10348:x1874634268009088:12345-0@lo:502:llog_process_th.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.115181:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787790706.116677:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10348:1874634268009088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790706.116761:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790706.116772:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790706.116774:0:10348:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787790706.116780:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787790706.116812:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10348:1874634268009216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.116870:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.116907:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.116976:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009216 00000100:00100000:1.0:1787790706.116988:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009216 00000100:00100000:1.0:1787790706.117024:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787790706.117033:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:10348:x1874634268009216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.117141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+19:10348:x1874634268009216:12345-0@lo:502:llog_process_th.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.117148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787790706.117282:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10348:1874634268009216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790706.117301:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790706.117305:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790706.117306:0:10348:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790706.117310:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787790706.117480:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787790706.117498:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787790706.117507:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.117518:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790706.117528:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790706.117530:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f3e20800 from 48 10000000:01000000:2.0:1787790706.117533:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790706.117567:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.117580:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.117590:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790706.117603:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.117632:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.117662:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.117785:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009344 00000100:00100000:1.0:1787790706.117790:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009344 00000100:00100000:1.0:1787790706.117815:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787790706.117821:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+19:6509:x1874634268009344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790706.117830:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790706.117842:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1da4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da43 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.117863:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1da4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da43 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.117873:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1da4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da43 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.117881:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e0200, rc 0) 00000100:00100000:1.0:1787790706.117913:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268009344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.117920:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787790706.118000:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790706.118013:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.118022:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.118077:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.118113:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.118134:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.118180:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009472 00000100:00100000:1.0:1787790706.118184:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009472 00000100:00100000:1.0:1787790706.118215:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787790706.118223:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268009472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.118327:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268009472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.118334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787790706.118662:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.118690:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.118752:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.118768:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.118816:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009600 00000100:00100000:1.0:1787790706.118820:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009600 00000100:00100000:1.0:1787790706.118850:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787790706.118856:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268009600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.118927:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268009600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.118934:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787790706.119359:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.120807:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10349:1874634268009728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.120883:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.120923:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.120986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009728 00000100:00100000:1.0:1787790706.120993:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009728 00000100:00100000:1.0:1787790706.121035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787790706.121045:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:10349:x1874634268009728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.121193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:10349:x1874634268009728:12345-0@lo:502:llog_process_th.0 Request processed in 149us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.121201:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787790706.121414:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10349:1874634268009728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.121483:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10349:1874634268009856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.121515:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790706.121634:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009856 00000100:00100000:1.0:1787790706.121639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009856 00000100:00100000:1.0:1787790706.121671:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787790706.121677:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:10349:x1874634268009856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.121771:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:10349:x1874634268009856:12345-0@lo:502:llog_process_th.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.121777:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787790706.121886:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787790706.121899:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10349:1874634268009856:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787790706.121918:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787790706.122073:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787790706.122106:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787790706.122116:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.122126:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790706.122136:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787790706.122139:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787790706.122142:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787790706.122168:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.122176:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.122184:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790706.122209:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.122240:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.122268:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.122313:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268009984 00000100:00100000:1.0:1787790706.122318:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268009984 00000100:00100000:1.0:1787790706.122360:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787790706.122367:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268009984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790706.122376:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790706.122388:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1da58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da51 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.122420:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1da58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da51 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.122431:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1da58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da51 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.122440:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e1e00, rc 0) 00000100:00100000:1.0:1787790706.122479:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268009984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.122485:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787790706.122968:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268009984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790706.122985:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.122994:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790706.123054:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.123085:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.123122:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.123168:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010112 00000100:00100000:1.0:1787790706.123173:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010112 00000100:00100000:1.0:1787790706.123208:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787790706.123217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268010112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.123329:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268010112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.123336:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787790706.124024:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.124062:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.124126:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.124148:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.124195:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010240 00000100:00100000:1.0:1787790706.124201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010240 00000100:00100000:1.0:1787790706.124235:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787790706.124242:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268010240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.124339:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268010240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.124352:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787790706.124535:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.125736:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10350:1874634268010368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790706.125798:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.125823:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.125911:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010368 00000100:00100000:1.0:1787790706.125918:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010368 00000100:00100000:1.0:1787790706.125972:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787790706.125982:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:10350:x1874634268010368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.126137:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:10350:x1874634268010368:12345-0@lo:502:llog_process_th.0 Request processed in 156us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.126145:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787790706.135831:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10350:1874634268010368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790706.135918:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790706.135932:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790706.135934:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787790706.135941:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787790706.135981:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10350:1874634268010496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.136059:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.136392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010496 00000100:00100000:2.0:1787790706.136410:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010496 00000100:00100000:2.0:1787790706.136470:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787790706.136488:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:10350:x1874634268010496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790706.136626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:10350:x1874634268010496:12345-0@lo:502:llog_process_th.0 Request processed in 139us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.136634:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787790706.137659:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787790706.137691:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10350:1874634268010496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790706.137889:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790706.137898:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790706.137900:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790706.137905:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787790706.139533:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787790706.139576:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787790706.139588:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.139601:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790706.139612:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787790706.139615:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170c2ab0800 from 48 10000000:01000000:2.0:1787790706.139619:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790706.139656:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.139664:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.139674:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790706.139698:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.139813:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.139853:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.140053:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010624 00000100:00100000:1.0:1787790706.140061:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010624 00000100:00100000:1.0:1787790706.140121:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787790706.140132:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268010624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790706.140145:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790706.140158:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da5f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.140180:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da5f expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.140192:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da5f expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.140200:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e1400, rc 0) 00000100:00100000:1.0:1787790706.140250:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268010624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.140257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787790706.140331:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790706.140345:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.140354:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.140418:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.140442:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.140458:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.140505:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010752 00000100:00100000:0.0:1787790706.140510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010752 00000100:00100000:0.0:1787790706.140540:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787790706.140547:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268010752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790706.140664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268010752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.140670:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787790706.140747:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.140775:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.140811:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.140833:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.140877:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268010880 00000100:00100000:0.0:1787790706.140881:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268010880 00000100:00100000:0.0:1787790706.140897:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787790706.140903:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268010880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790706.140996:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268010880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.141003:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787790706.141254:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268010880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.141950:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10351:1874634268011008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.141996:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.142027:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.142082:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011008 00000100:00100000:2.0:1787790706.142087:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011008 00000100:00100000:2.0:1787790706.142143:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787790706.142151:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:10351:x1874634268011008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790706.142250:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:10351:x1874634268011008:12345-0@lo:502:llog_process_th.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.142257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787790706.142339:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10351:1874634268011008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.142376:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10351:1874634268011136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790706.142425:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.142445:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790706.142485:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011136 00000100:00100000:1.0:1787790706.142495:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011136 00000100:00100000:1.0:1787790706.142515:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787790706.142521:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:10351:x1874634268011136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.142605:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:10351:x1874634268011136:12345-0@lo:502:llog_process_th.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.142611:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787790706.142670:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10351:1874634268011136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787790706.142686:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787790706.143041:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787790706.143059:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790706.143068:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.143078:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790706.143087:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787790706.143099:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787790706.143102:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787790706.143127:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.143134:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790706.143143:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790706.143156:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.143184:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790706.143203:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.143355:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011264 00000100:00100000:0.0:1787790706.143360:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011264 00000100:00100000:0.0:1787790706.143389:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787790706.143405:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268011264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790706.143414:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790706.143426:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0031a00/0xcf9477fddcf1da74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da6d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.143466:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031a00/0xcf9477fddcf1da74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da6d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.143489:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0031a00/0xcf9477fddcf1da74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da6d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.143499:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031a00, rc 0) 00000100:00100000:0.0:1787790706.143620:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268011264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.143628:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787790706.143788:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790706.143801:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790706.143822:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790706.143876:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.143904:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.143917:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.144379:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011392 00000100:00100000:2.0:1787790706.144385:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011392 00000100:00100000:2.0:1787790706.144421:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787790706.144428:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268011392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.144555:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268011392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.144561:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787790706.144866:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.144898:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790706.144937:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790706.144965:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.145003:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011520 00000100:00100000:2.0:1787790706.145008:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011520 00000100:00100000:2.0:1787790706.145037:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787790706.145043:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268011520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.145214:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268011520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.145221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787790706.145295:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.155195:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10352:1874634268011648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790706.155291:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790706.155326:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.155408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011648 00000100:00100000:0.0:1787790706.155415:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011648 00000100:00100000:0.0:1787790706.155465:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787790706.155475:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:10352:x1874634268011648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790706.155622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:10352:x1874634268011648:12345-0@lo:502:llog_process_th.0 Request processed in 148us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.155630:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787790706.155798:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10352:1874634268011648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790706.155827:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790706.155835:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790706.155837:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787790706.155844:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787790706.155864:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10352:1874634268011776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790706.155899:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.155937:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790706.156046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011776 00000100:00100000:0.0:1787790706.156051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011776 00000100:00100000:0.0:1787790706.156083:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787790706.156100:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:10352:x1874634268011776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790706.156161:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:10352:x1874634268011776:12345-0@lo:502:llog_process_th.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.156168:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787790706.156273:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10352:1874634268011776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790706.156292:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790706.156295:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790706.156297:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787790706.156301:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787790706.156484:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787790706.156508:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787790706.156518:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.156551:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790706.156563:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787790706.156566:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9170d6383370 from 1 10000000:01000000:0.0:1787790706.156569:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787790706.156596:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.156604:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.156613:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790706.156627:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790706.156658:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790706.156681:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.156821:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268011904 00000100:00100000:2.0:1787790706.156825:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268011904 00000100:00100000:2.0:1787790706.156848:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787790706.156854:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268011904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790706.156863:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790706.156874:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1da82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1da7b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.156896:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1da82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1da7b expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.156906:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1da82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1da7b expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.156913:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38c00, rc 0) 00000100:00100000:2.0:1787790706.156941:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268011904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.156947:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787790706.157482:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268011904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790706.157496:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.157505:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790706.157569:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268012032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790706.157599:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790706.157643:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790706.157781:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012032 00000100:00100000:2.0:1787790706.157786:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012032 00000100:00100000:2.0:1787790706.157823:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787790706.157830:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268012032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790706.157898:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268012032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (298us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790706.157912:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787790706.158377:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268012032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787790706.158413:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787790706.158421:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.158430:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790706.502052:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790706.502262:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130432 00000100:00100000:2.0:1787790706.502275:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130432 00000100:00100000:2.0:1787790706.502357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 240 00000100:00100000:2.0:1787790706.502370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:6170:x1874634250130432:12345-192.168.202.22@tcp:101: 00010000:00010000:2.0:1787790706.502422:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790706.502447:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1da89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223a9b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.502488:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a9b expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.502503:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a9b expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790706.502514:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39c00, rc 0) 00000100:00100000:2.0:1787790706.502602:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250130432:12345-192.168.202.22@tcp:101: Request processed in 235us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.502611:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 240 00000100:00100000:1.0:1787790706.506071:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790706.506272:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130560 00000100:00100000:0.0:1787790706.506285:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130560 00000100:00100000:0.0:1787790706.506370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 241 00000100:00100000:0.0:1787790706.506383:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250130560:12345-192.168.202.22@tcp:501: 00000100:00100000:0.0:1787790706.506612:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250130560:12345-192.168.202.22@tcp:501: Request processed in 230us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.506621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 241 00000100:00100000:2.0:1787790706.508008:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790706.508039:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790706.508138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790706.508201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012160 00000100:00100000:2.0:1787790706.508208:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012160 00000100:00100000:2.0:1787790706.508261:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790706.508271:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268012160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790706.508532:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787790706.508688:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268012160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 417us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.508698:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790706.508807:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790706.508973:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268012288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790706.509013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790706.509048:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012288 00000100:00100000:1.0:1787790706.509052:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012288 00000100:00100000:1.0:1787790706.509081:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790706.509087:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268012288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790706.509126:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790706.509166:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268012288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.509173:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787790706.509208:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268012288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787790706.509699:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790706.513624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790706.513796:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130688 00000100:00100000:0.0:1787790706.513811:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130688 00000100:00100000:0.0:1787790706.513882:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 242 00000100:00100000:0.0:1787790706.513894:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250130688:12345-192.168.202.22@tcp:503: 00000100:00100000:0.0:1787790706.514321:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250130688:12345-192.168.202.22@tcp:503: Request processed in 426us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.514330:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 242 00000100:00100000:3.0:1787790706.530141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790706.532096:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130816 00000100:00100000:2.0:1787790706.532119:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130816 00000100:00100000:2.0:1787790706.532233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 243 00000100:00100000:2.0:1787790706.532247:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6648:x1874634250130816:12345-192.168.202.22@tcp:502: 00000100:00100000:2.0:1787790706.532509:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6648:x1874634250130816:12345-192.168.202.22@tcp:502: Request processed in 264us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790706.532518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 243 00000100:00100000:2.0:1787790706.535818:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790706.537892:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250130944 00000100:00100000:1.0:1787790706.537906:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250130944 00000100:00100000:1.0:1787790706.538213:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 244 00000100:00100000:1.0:1787790706.538222:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6648:x1874634250130944:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790706.538383:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6648:x1874634250130944:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 161us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.538400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 244 00000100:00100000:1.0:1787790706.552123:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790706.552256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131072 00000100:00100000:0.0:1787790706.552278:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131072 00000100:00100000:0.0:1787790706.552416:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 245 00000100:00100000:0.0:1787790706.552429:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250131072:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790706.552452:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790706.552478:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1da90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223aa2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.552519:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1da90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa2 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.552536:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1da90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa2 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790706.552548:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030c00, rc 0) 00000100:00100000:0.0:1787790706.552640:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250131072:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 213us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790706.552649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 245 00000100:00100000:3.0:1787790706.571637:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790706.573065:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131200 00000100:00100000:1.0:1787790706.573080:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131200 00000100:00100000:1.0:1787790706.573164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 246 00000100:00100000:1.0:1787790706.573174:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250131200:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790706.573314:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250131200:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 140us (1689us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790706.573321:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 246 00000100:00100000:0.0:1787790706.628827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790706.628881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790706.628912:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790706.628960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790706.629729:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131712 00000100:00100000:3.0:1787790706.629742:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131712 00000100:00100000:3.0:1787790706.629815:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131584 00000100:00100000:3.0:1787790706.629818:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131584 00000100:00100000:3.0:1787790706.629861:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:3.0:1787790706.629871:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250131712:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790706.629954:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250131712:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 84us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790706.629961:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:3.0:1787790706.629977:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790706.629983:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250131584:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790706.630004:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250131584:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 22us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790706.630010:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:1.0:1787790706.630579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131456 00000100:00100000:1.0:1787790706.630586:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131456 00000100:00100000:1.0:1787790706.630624:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131328 00000100:00100000:1.0:1787790706.630628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131328 00000100:00100000:1.0:1787790706.630650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:1.0:1787790706.630658:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250131456:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790706.630696:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250131456:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 39us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.630702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:1.0:1787790706.630744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:1.0:1787790706.630751:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250131328:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790706.630776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250131328:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790706.630794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00080000:0.0:1787790706.631798:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790706.631806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790706.631810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790706.631813:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787790707.531453:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790708.043457:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268012416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.043572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.043639:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268012928:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.043669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.043748:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268013440:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.045464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.045536:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268013952:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.045595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.045631:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787790708.045639:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268012544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.045665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.045688:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268013056:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.045731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.045750:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3716d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268013568:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.045773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790708.045922:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012416 00000100:00100000:2.0:1787790708.045933:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012416 00000100:00100000:2.0:1787790708.046011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787790708.046023:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268012416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.046088:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268012416:12345-0@lo:400:kworker.0 Request processed in 68us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.046096:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787790708.047091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268014080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790708.047438:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012928 00000100:00100000:2.0:1787790708.047446:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012928 00000100:00100000:2.0:1787790708.047495:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012544 00000100:00100000:2.0:1787790708.047498:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012544 00000100:00100000:2.0:1787790708.047509:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013056 00000100:00100000:2.0:1787790708.047512:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013056 00000100:00100000:2.0:1787790708.047535:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013568 00000100:00100000:2.0:1787790708.047538:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013568 00000100:00100000:2.0:1787790708.047553:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787790708.047574:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268012928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.047887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790708.048040:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268012928:12345-0@lo:400:kworker.0 Request processed in 466us (4368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.048049:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787790708.048072:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790708.048081:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268012544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.048115:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268012544:12345-0@lo:400:kworker.0 Request processed in 36us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.048121:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790708.048133:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790708.048481:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268012416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048501:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268012928:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048541:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268012544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048578:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268012672:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.048647:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268013184:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.048684:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3714f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268013696:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.048754:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787790708.048788:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268012800:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.048841:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268013312:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048864:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790708.048885:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3717c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268013824:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.048906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790708.050230:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.050332:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268013056:12345-0@lo:400:kworker.0 Request processed in 2192us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.050342:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787790708.050389:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013184 00000100:00100000:2.0:1787790708.050397:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013184 00000100:00100000:2.0:1787790708.050430:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013696 00000100:00100000:2.0:1787790708.050432:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013696 00000100:00100000:2.0:1787790708.050448:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790708.050457:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.050489:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268013568:12345-0@lo:400:kworker.0 Request processed in 34us (4716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.050494:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790708.050505:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787790708.050511:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.050550:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268013184:12345-0@lo:400:kworker.0 Request processed in 39us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.050566:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787790708.050578:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790708.050585:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268013696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.050634:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268013696:12345-0@lo:400:kworker.0 Request processed in 49us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.050640:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787790708.050673:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790708.050678:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790708.050694:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014080 00000100:00100000:2.0:1787790708.050698:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014080 00000100:00100000:2.0:1787790708.050758:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790708.050765:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268014080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787790708.050807:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790708.050843:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268014080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.050849:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790708.050871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012672 00000100:00100000:2.0:1787790708.050875:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012672 00000100:00100000:2.0:1787790708.050902:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268012800 00000100:00100000:2.0:1787790708.050906:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268012800 00000100:00100000:2.0:1787790708.050920:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790708.050925:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268012672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.051392:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013440 00000100:00100000:0.0:1787790708.051397:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013440 00000100:00100000:0.0:1787790708.051427:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013952 00000100:00100000:0.0:1787790708.051431:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013952 00000100:00100000:0.0:1787790708.051447:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013312 00000100:00100000:0.0:1787790708.051449:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013312 00000100:00100000:0.0:1787790708.051463:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268013824 00000100:00100000:0.0:1787790708.051466:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268013824 00000100:00100000:0.0:1787790708.051482:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790708.051488:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268013440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.051534:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268013440:12345-0@lo:400:kworker.0 Request processed in 46us (6081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790708.051541:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790708.051555:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790708.051561:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268013952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.051592:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268013952:12345-0@lo:400:kworker.0 Request processed in 31us (5996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790708.051598:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790708.051609:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790708.051615:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268013312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.051645:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268013312:12345-0@lo:400:kworker.0 Request processed in 30us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790708.051662:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790708.051674:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790708.051680:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268013824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.051731:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268013824:12345-0@lo:400:kworker.0 Request processed in 51us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790708.051737:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787790708.053814:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790708.053853:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268014208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790708.053946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790708.054413:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014208 00000100:00100000:2.0:1787790708.054424:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014208 00000100:00100000:2.0:1787790708.054492:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790708.054504:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268014208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790708.054539:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790708.054614:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268014208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.054623:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790708.054809:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790708.054828:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268012800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.054879:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268012800:12345-0@lo:400:kworker.0 Request processed in 58us (6061us total) trans 0 rc 0/0 00000100:00080000:2.0:1787790708.056083:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790708.056094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790708.056175:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268012800:0@lo:400:kworker.0 00010000:00080000:2.0:1787790708.056198:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bf840 x1874634268013312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056209:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268013312:0@lo:400:kworker.0 00010000:00080000:2.0:1787790708.056221:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3717c00 x1874634268013824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056229:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3717c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268013824:0@lo:400:kworker.0 00010000:00080000:2.0:1787790708.056244:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bd680 x1874634268013184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056252:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268013184:0@lo:400:kworker.0 00010000:00080000:2.0:1787790708.056264:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3714f00 x1874634268013696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056273:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3714f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268013696:0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.056326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268013056:0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.056342:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3716d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268013568:0@lo:400:kworker.0 00010000:00080000:2.0:1787790708.056354:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3715e00 x1874634268014080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056395:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268014080:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787790708.056423:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bda40 x1874634268013440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268013440:0@lo:400:kworker.0 00010000:00080000:2.0:1787790708.056445:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3714b40 x1874634268013952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790708.056453:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268013952:0@lo:400:kworker.0 00000100:00100000:2.0:1787790708.056548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268012672:12345-0@lo:400:kworker.0 Request processed in 5621us (7926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790708.056560:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787790708.056599:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268012672:0@lo:400:kworker.0 00000100:00100000:0.0:1787790708.057053:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787790708.062857:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bc3c0 x1874634268014208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790708.062898:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268014208:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787790708.242323:0:10389:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2fbaaf00 20000000:00000080:1.0:1787790708.242349:0:10389:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff916fc37af800 uarg=0000000000000000 20000000:01000000:1.0:1787790708.246297:0:10389:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787790708.246310:0:10389:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787790708.246317:0:10389:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787790708.247474:0:10390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787790708.247666:0:10389:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787790708.255267:0:10389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787790708.255318:0:10389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787790708.255336:0:10389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787790708.255357:0:10389:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787790708.255395:0:10389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255419:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255427:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255434:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255441:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255471:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255481:0:10389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255534:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255552:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 9 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790708.255570:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014336:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790708.255737:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.255746:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 23 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790708.255757:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014464:0@lo:104: 00000100:00100000:2.0:1787790708.257221:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790708.257340:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.257356:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 23 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790708.257372:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014592:0@lo:104: 00000100:00100000:2.0:1787790708.257446:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790708.257601:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.257610:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 23 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790708.257619:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014720:0@lo:104: 00010000:00010000:2.0:1787790708.257647:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790708.257654:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 23 pid: 6505 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790708.257661:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014848:0@lo:104: 00000100:00100000:2.0:1787790708.257678:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65480 going to sleep for 11 seconds 00000100:00100000:3.0:1787790708.257889:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787790708.257911:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.257938:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.257959:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014464 00000100:00100000:3.0:1787790708.257967:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014464 00000100:00100000:3.0:1787790708.258029:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014592 00000100:00100000:3.0:1787790708.258033:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014592 00000100:00100000:3.0:1787790708.258043:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014720 00000100:00100000:3.0:1787790708.258045:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014720 00000100:00100000:3.0:1787790708.258054:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014848 00000100:00100000:3.0:1787790708.258056:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014848 00000100:00100000:3.0:1787790708.258069:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790708.258078:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+6:10389:x1874634268014464:12345-0@lo:104: 00010000:00010000:3.0:1787790708.258093:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258186:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790708.258193:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+6:10389:x1874634268014464:12345-0@lo:104: Request processed in 117us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.258202:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787790708.258225:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787790708.258231:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:10389:x1874634268014592:12345-0@lo:104: 00010000:00010000:3.0:1787790708.258242:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258437:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787790708.258444:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+5:10389:x1874634268014592:12345-0@lo:104: Request processed in 214us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.258450:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787790708.258492:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790708.258499:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:10389:x1874634268014720:12345-0@lo:104: 00010000:00010000:3.0:1787790708.258507:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258540:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787790708.258546:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:10389:x1874634268014720:12345-0@lo:104: Request processed in 48us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.258552:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790708.258563:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790708.258568:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:10389:x1874634268014848:12345-0@lo:104: 00010000:00010000:3.0:1787790708.258575:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258610:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787790708.258614:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:10389:x1874634268014848:12345-0@lo:104: Request processed in 46us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.258620:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787790708.258642:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787790708.258649:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258658:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790708.258663:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258673:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790708.258680:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790708.258686:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790708.258758:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258766:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790708.258812:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258820:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38800/0xcf9477fddcf1d8b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d8bb expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258850:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787790708.258854:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258860:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790708.258863:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258871:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790708.258877:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790708.258882:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790708.258895:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258900:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790708.258920:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258927:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1000/0xcf9477fddcf1d78e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d795 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258938:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790708.258940:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258958:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790708.258961:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.258968:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790708.258975:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790708.258980:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790708.258995:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259001:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790708.259007:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259015:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38400/0xcf9477fddcf1d73a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d741 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259024:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790708.259028:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259034:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e0e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790708.259037:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259057:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790708.259064:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790708.259069:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787790708.259085:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259091:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790708.259097:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259104:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e0e00/0xcf9477fddcf1d72c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1d733 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.259123:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790708.259124:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790708.259126:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790708.259136:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790708.259143:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790708.259157:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3089e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268014976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790708.259201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.259242:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790708.259249:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268015360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790708.259270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.259304:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268015104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790708.259337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.259358:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790708.259363:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268015232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790708.259475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790708.259508:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268014976 00000100:00100000:3.0:1787790708.259515:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268014976 00000100:00100000:0.0:1787790708.260384:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014464:0@lo:104: 00000100:00100000:0.0:1787790708.260400:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014592:0@lo:104: 00000100:00100000:0.0:1787790708.260408:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014720:0@lo:104: 00000100:00100000:0.0:1787790708.260418:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014848:0@lo:104: 00010000:00010000:3.0:1787790708.261129:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 24 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790708.261175:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015360 00000100:00100000:3.0:1787790708.261180:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015360 00010000:00010000:3.0:1787790708.261198:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 25 pid: 6505 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790708.261209:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015104 00000100:00100000:3.0:1787790708.261212:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015104 00010000:00010000:3.0:1787790708.261223:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 26 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790708.261232:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015232 00000100:00100000:3.0:1787790708.261235:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015232 00010000:00010000:3.0:1787790708.261245:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 27 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790708.261269:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790708.261279:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+27:3639:x1874634268014976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790708.261293:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790708.261299:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 27 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261330:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 27 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261350:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38200/0xcf9477fddcf1d8bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d8b4 expref: 27 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261370:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790708.261452:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+26:3639:x1874634268014976:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.261460:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790708.261479:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790708.261484:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+25:3639:x1874634268015360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790708.261492:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790708.261496:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 25 pid: 6505 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261504:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 25 pid: 6505 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261514:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1d733 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d72c expref: 25 pid: 6505 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261523:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790708.261543:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268015360:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.261549:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790708.261559:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790708.261564:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+23:3640:x1874634268015104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790708.261580:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790708.261585:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 23 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261593:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 23 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261603:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39000/0xcf9477fddcf1d795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d78e expref: 23 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261612:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790708.261640:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+22:3640:x1874634268015104:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.261645:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790708.261656:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787790708.261663:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c6461850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+21:3640:x1874634268015232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790708.261670:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790708.261674:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 21 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261681:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 21 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261689:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030a00/0xcf9477fddcf1d741 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1d73a expref: 21 pid: 6507 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.261697:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790708.261743:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c6461850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+20:3640:x1874634268015232:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.261757:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787790708.261854:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268015232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790708.261865:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268015104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790708.262240:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268015360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790708.262249:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3089e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268014976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790708.262402:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1787790708.262771:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790708.262919:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1874634268014336:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790708.262967:0:10389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790708.263159:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131840 00000100:00100000:3.0:1787790708.263165:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131840 00010000:00010000:3.0:1787790708.263199:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 10 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790708.263235:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:3.0:1787790708.263241:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250131840:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790708.263256:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790708.263274:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 10 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263286:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 10 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263305:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9ea00/0xcf9477fddcf1d9d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a63 expref: 10 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263322:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263332:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263351:0:8442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263383:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263391:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263399:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263406:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790708.263412:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263422:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263442:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.263453:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790708.263512:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:2403:x1874634250131840:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 270us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790708.263521:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00010000:00010000:1.0:1787790708.263636:0:10389:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790708.263645:0:10389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790708.263653:0:10389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38000/0xcf9477fddcf1da97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790708.558685:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790709.508945:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790709.508999:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250131968 00000100:00100000:2.0:1787790709.509009:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250131968 00000100:00100000:2.0:1787790709.509080:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 248 00000100:00100000:2.0:1787790709.509092:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:6170:x1874634250131968:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790709.509111:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790709.509131:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223aa9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790709.509160:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790709.509172:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790709.509201:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165e800, rc 0) 00000100:00100000:2.0:1787790709.509271:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250131968:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 181us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790709.509278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 248 00000100:00100000:2.0:1787790709.514467:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 10000000:01000000:3.0:1787790709.516038:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790709.516046:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f67a4800 from 4 10000000:01000000:3.0:1787790709.516051:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790709.516098:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790709.516125:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790709.516135:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790709.516158:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268015488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.516221:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790709.534281:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132096 00000100:00100000:1.0:1787790709.534295:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132096 00000100:00100000:1.0:1787790709.534391:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015488 00000100:00100000:1.0:1787790709.534396:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015488 00000100:00100000:1.0:1787790709.534421:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 249 00000100:00100000:1.0:1787790709.534429:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250132096:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790709.534586:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250132096:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 157us (20126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790709.534595:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 249 00000100:00100000:1.0:1787790709.534637:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787790709.534644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268015488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790709.534654:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790709.534671:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1daa5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790709.534698:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790709.534733:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790709.534742:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917102178600, rc 0) 00000100:00100000:1.0:1787790709.534791:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268015488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (18569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790709.534798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787790709.541053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790709.541635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132224 00000100:00100000:3.0:1787790709.541644:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132224 00000100:00100000:3.0:1787790709.541700:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 251 00000100:00100000:3.0:1787790709.541970:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250132224:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.542116:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6170:x1874634250132224:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 149us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790709.547846:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 251 00000100:00100000:3.0:1787790709.554180:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790709.554220:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268015488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790709.554247:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790709.554260:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790709.554342:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268015616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.554421:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790709.554454:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015616 00000100:00100000:3.0:1787790709.554459:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015616 00000100:00100000:3.0:1787790709.554500:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787790709.554508:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268015616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.554629:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268015616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790709.554637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787790709.554669:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790709.554681:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268015616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.557308:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268015744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.557412:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790709.557459:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015744 00000100:00100000:3.0:1787790709.557466:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015744 00000100:00100000:3.0:1787790709.557533:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787790709.557544:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268015744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.557665:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268015744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790709.557673:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787790709.558636:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790709.558667:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268015744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790709.567035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790709.569646:0:10426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10426:1874634268015872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.571464:0:10426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.571530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132352 00000100:00100000:0.0:1787790709.571539:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132352 00000100:00100000:0.0:1787790709.571580:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268015872 00000100:00100000:0.0:1787790709.571589:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268015872 00000100:00100000:0.0:1787790709.571609:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 254 00000100:00100000:0.0:1787790709.571619:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6706:x1874634250132352:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790709.571806:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6706:x1874634250132352:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 187us (4780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790709.571812:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787790709.571956:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:10426:x1874634268015872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790709.572040:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:10426:x1874634268015872:12345-0@lo:502:llog_process_th.0 Request processed in 220us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.573307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 254 00000100:00100000:0.0:1787790709.573389:0:10426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3ff6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.573418:0:10426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10426:1874634268015872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790709.573451:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790709.573462:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790709.573464:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787790709.573471:0:10426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f67a4800 00000020:00000080:0.0:1787790709.573473:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790709.573568:0:10426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10426:1874634268016000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.573623:0:10426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.573654:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016000 00000100:00100000:0.0:1787790709.573659:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016000 00000100:00100000:0.0:1787790709.573692:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787790709.573699:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:10426:x1874634268016000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.573887:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:10426:x1874634268016000:12345-0@lo:502:llog_process_th.0 Request processed in 187us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.573895:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787790709.573941:0:10426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3dec600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.573954:0:10426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10426:1874634268016000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790709.573973:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790709.573977:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790709.573984:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787790709.573987:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787790709.574049:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787790709.574071:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790709.574080:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.574090:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790709.574100:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790709.574103:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3c78800 from 4 10000000:01000000:0.0:1787790709.574106:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790709.574128:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.574136:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.574145:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790709.574158:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.574185:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.574198:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.574210:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016128 00000100:00100000:0.0:1787790709.574213:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016128 00000100:00100000:0.0:1787790709.574235:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787790709.574240:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790709.574249:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787790709.574252:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00010000:0.0:1787790709.574265:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.574284:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.574295:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.574303:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030200, rc 0) 00000100:00100000:0.0:1787790709.574340:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.574346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787790709.574362:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790709.574387:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790709.574396:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790709.574451:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790709.574478:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790709.574498:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.574621:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016256 00000100:00100000:0.0:1787790709.574625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016256 00000100:00100000:0.0:1787790709.574658:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787790709.574666:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.574844:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.574851:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787790709.574853:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790709.576125:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790709.576220:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790709.576256:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.577230:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016384 00000100:00100000:0.0:1787790709.577240:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016384 00000100:00100000:0.0:1787790709.577286:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787790709.577295:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.577427:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.577434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787790709.577498:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.579852:0:10429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10429:1874634268016512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.579945:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.580000:0:10429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c4af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790709.580023:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016512 00000100:00100000:2.0:1787790709.580032:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016512 00000100:00100000:2.0:1787790709.580085:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787790709.580095:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:10429:x1874634268016512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790709.580222:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:10429:x1874634268016512:12345-0@lo:502:llog_process_th.0 Request processed in 129us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790709.580230:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787790709.580398:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00010000:00010000:3.0:1787790709.581547:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790709.581732:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132480 00000100:00100000:0.0:1787790709.581740:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132480 00000100:00100000:0.0:1787790709.581780:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 261 00000100:00100000:0.0:1787790709.581788:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6706:x1874634250132480:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790709.581900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:6706:x1874634250132480:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 111us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.581907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 261 00000100:00100000:0.0:1787790709.581964:0:10429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10429:1874634268016512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790709.581998:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790709.582007:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790709.582009:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787790709.582015:0:10429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f3c78800 00000020:00000080:0.0:1787790709.582017:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790709.582084:0:10429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10429:1874634268016640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.582129:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.582151:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016640 00000100:00100000:0.0:1787790709.582154:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016640 00000100:00100000:0.0:1787790709.582171:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787790709.582176:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:10429:x1874634268016640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.582234:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:10429:x1874634268016640:12345-0@lo:502:llog_process_th.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.582242:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787790709.582286:0:10429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.582298:0:10429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10429:1874634268016640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790709.582314:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790709.582318:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790709.582320:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787790709.582323:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787790709.582388:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787790709.582407:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790709.582417:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582427:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790709.582437:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790709.582439:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3e20800 from 4 10000000:01000000:0.0:1787790709.582441:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790709.582462:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582471:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582480:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790709.582491:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.582514:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.582525:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.582535:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016768 00000100:00100000:0.0:1787790709.582542:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016768 00000100:00100000:0.0:1787790709.582560:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787790709.582566:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268016768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790709.582573:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790709.582583:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dac1 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582602:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582612:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582620:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030600, rc 0) 00000100:00100000:0.0:1787790709.582643:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268016768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.582649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787790709.582672:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790709.582683:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.582692:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790709.582749:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.582771:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.582781:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.582790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268016896 00000100:00100000:0.0:1787790709.582798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268016896 00000100:00100000:0.0:1787790709.582816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787790709.582821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268016896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.582902:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268016896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.582907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787790709.582935:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268016896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.582959:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.582988:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.582998:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.583008:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017024 00000100:00100000:0.0:1787790709.583011:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017024 00000100:00100000:0.0:1787790709.583027:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787790709.583032:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268017024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.583085:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268017024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.583091:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787790709.583122:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790709.593278:0:10431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10431:1874634268017152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790709.593374:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790709.593429:0:10431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed915c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.597376:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017152 00000100:00100000:0.0:1787790709.597393:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017152 00000100:00100000:0.0:1787790709.597453:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787790709.597463:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:10431:x1874634268017152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.597643:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:10431:x1874634268017152:12345-0@lo:502:llog_process_th.0 Request processed in 181us (4280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.597651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787790709.599897:0:10431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10431:1874634268017152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790709.599942:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790709.599957:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790709.599959:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787790709.599966:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f3e20800 00000020:00000080:3.0:1787790709.599969:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787790709.600076:0:10431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10431:1874634268017280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790709.600151:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790709.600200:0:10431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed915c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.604378:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017280 00000100:00100000:0.0:1787790709.604393:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017280 00000100:00100000:0.0:1787790709.604479:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787790709.604490:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:10431:x1874634268017280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.604662:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:10431:x1874634268017280:12345-0@lo:502:llog_process_th.0 Request processed in 174us (4511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.604670:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787790709.605041:0:10431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10431:1874634268017280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790709.605077:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790709.605086:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790709.605088:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787790709.605093:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787790709.606995:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787790709.607032:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790709.607046:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.607059:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790709.607070:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790709.607073:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c2ab0800 from 4 10000000:01000000:0.0:1787790709.607076:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790709.607109:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.607117:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.607128:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790709.607153:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.607233:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.607283:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.607307:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017408 00000100:00100000:0.0:1787790709.607313:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017408 00000100:00100000:0.0:1787790709.607359:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787790709.607381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268017408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790709.607395:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790709.607406:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dacf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.607429:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.607441:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790709.607449:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030000, rc 0) 00000100:00100000:0.0:1787790709.607492:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268017408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.607498:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787790709.608660:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790709.608684:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790709.608693:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790709.611901:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790709.611971:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790709.612009:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790709.612032:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017536 00000100:00100000:2.0:1787790709.612037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017536 00000100:00100000:2.0:1787790709.612818:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790709.612831:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268017536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790709.612991:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268017536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790709.612999:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790709.613051:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790709.613089:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790709.613131:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790709.613159:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.614328:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017664 00000100:00100000:0.0:1787790709.614338:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017664 00000100:00100000:0.0:1787790709.614415:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787790709.614424:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268017664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.614549:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268017664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.614557:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787790709.614610:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268017664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790709.627557:0:10435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10435:1874634268017792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.627661:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.627698:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017792 00000100:00100000:0.0:1787790709.627782:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017792 00000100:00100000:0.0:1787790709.627821:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787790709.627830:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:10435:x1874634268017792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.627940:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:10435:x1874634268017792:12345-0@lo:502:llog_process_th.0 Request processed in 109us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790709.627947:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787790709.627996:0:10435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790709.628019:0:10435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10435:1874634268017792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790709.628046:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790709.628055:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790709.628057:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787790709.628064:0:10435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170c2ab0800 00000020:00000080:0.0:1787790709.628066:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790709.628144:0:10435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10435:1874634268017920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790709.628191:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790709.628209:0:10435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0c1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790709.628350:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268017920 00000100:00100000:1.0:1787790709.628355:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268017920 00000100:00100000:1.0:1787790709.628399:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787790709.628406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:10435:x1874634268017920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790709.628482:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:10435:x1874634268017920:12345-0@lo:502:llog_process_th.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790709.628488:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787790709.629854:0:10435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:10435:1874634268017920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790709.629902:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790709.629914:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790709.629916:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787790709.629920:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787790709.630156:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787790709.630185:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790709.630197:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790709.630209:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790710.604004:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790710.604038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790710.604105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790710.604157:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790710.604170:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018048 00000100:00100000:2.0:1787790710.604177:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018048 00000100:00100000:2.0:1787790710.604228:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787790710.604238:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268018048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790710.604264:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790710.604308:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268018048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790710.604315:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787790710.604336:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790710.604375:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37e0780 x1874634268018048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790710.604395:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790710.605567:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790710.605585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268018176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790710.605636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790710.607264:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018176 00000100:00100000:0.0:1787790710.607276:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018176 00000100:00100000:0.0:1787790710.607347:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790710.607369:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268018176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790710.607405:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790710.607488:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268018176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790710.607495:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787790710.607623:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bcb40 x1874634268018176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790710.607644:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268018176:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787790710.607733:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790711.627880:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268018304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790711.627935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790711.627984:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790711.627993:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018304 00000100:00100000:2.0:1787790711.627999:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018304 00000100:00100000:2.0:1787790711.628030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790711.628036:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268018304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790711.628065:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787790711.628095:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268018304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790711.628100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790711.628132:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268018304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790711.628516:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268018432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790711.628540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790711.628598:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018432 00000100:00100000:3.0:1787790711.628603:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018432 00000100:00100000:3.0:1787790711.628641:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787790711.628650:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268018432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787790711.628680:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787790711.628746:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268018432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790711.628754:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787790711.628769:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268018432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790711.748537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790711.748645:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790711.748736:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790711.748764:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790711.748824:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132608 00000100:00100000:1.0:1787790711.748834:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132608 00000100:00100000:1.0:1787790711.748888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 273 00000100:00100000:1.0:1787790711.748897:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250132608:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790711.748970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250132608:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790711.748980:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 273 00000100:00100000:0.0:1787790711.749295:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132992 00000100:00100000:0.0:1787790711.749300:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132992 00000100:00100000:0.0:1787790711.749364:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787790711.749373:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250132992:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790711.749407:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250132992:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 37us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790711.749414:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00080000:1.0:1787790711.749563:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790711.749880:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132736 00000100:00100000:2.0:1787790711.749887:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132736 00000100:00100000:2.0:1787790711.749930:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250132864 00000100:00100000:2.0:1787790711.749933:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250132864 00000100:00100000:2.0:1787790711.749956:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:2.0:1787790711.749963:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250132736:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790711.749964:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790711.749999:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250132736:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 36us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790711.750006:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787790711.750072:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133120 00000100:00100000:3.0:1787790711.750076:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133120 00000100:00100000:3.0:1787790711.750107:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:3.0:1787790711.750114:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250133120:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790711.750147:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250133120:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790711.750153:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:2.0:1787790711.751443:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:2.0:1787790711.751636:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250132864:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790711.751781:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250132864:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 149us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790711.751789:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00080000:2.0:1787790711.751815:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790711.751820:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790711.751823:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790712.654378:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790713.163169:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268018944:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.163250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790713.163424:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268018560:0@lo:400:kworker.0 00000100:00100000:3.0:1787790713.163463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.163837:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268019456:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.163882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.163908:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268019968:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.163948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.163985:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268018688:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.164027:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268019200:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.164061:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268019712:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.164100:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787790713.164107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268018816:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.164160:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268019328:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164183:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.164199:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268019840:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.164252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018944 00000100:00100000:1.0:1787790713.164259:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018944 00000100:00100000:1.0:1787790713.164302:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018816 00000100:00100000:1.0:1787790713.164305:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018816 00000100:00100000:1.0:1787790713.164322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787790713.164342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268018944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164400:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268018944:12345-0@lo:400:kworker.0 Request processed in 69us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787790713.164428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787790713.164434:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268018816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268018816:12345-0@lo:400:kworker.0 Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164473:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787790713.164491:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018688 00000100:00100000:1.0:1787790713.164494:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018688 00000100:00100000:1.0:1787790713.164511:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019200 00000100:00100000:1.0:1787790713.164513:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019200 00000100:00100000:1.0:1787790713.164533:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019712 00000100:00100000:1.0:1787790713.164536:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019712 00000100:00100000:1.0:1787790713.164548:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019328 00000100:00100000:1.0:1787790713.164551:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019328 00000100:00100000:1.0:1787790713.164562:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019840 00000100:00100000:1.0:1787790713.164564:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019840 00000100:00100000:1.0:1787790713.164577:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787790713.164592:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268018688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164623:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268018688:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164629:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787790713.164642:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787790713.164647:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268019200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164669:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268019200:12345-0@lo:400:kworker.0 Request processed in 23us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164675:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787790713.164683:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787790713.164688:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268019712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164727:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268019712:12345-0@lo:400:kworker.0 Request processed in 39us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164733:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787790713.164744:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790713.164761:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268019328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164784:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268019328:12345-0@lo:400:kworker.0 Request processed in 35us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164789:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790713.164798:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787790713.164803:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268019840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164821:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268019840:12345-0@lo:400:kworker.0 Request processed in 18us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.164826:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787790713.164866:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268018816:0@lo:400:kworker.0 00010000:00080000:1.0:1787790713.164887:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bed00 x1874634268019328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.164897:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268019328:0@lo:400:kworker.0 00010000:00080000:1.0:1787790713.164905:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bc780 x1874634268019840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.164913:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268019840:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164921:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268018688:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164929:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268019200:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164936:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268019712:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.164969:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268018944:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.165003:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019456 00000100:00100000:1.0:1787790713.165006:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019456 00000100:00100000:1.0:1787790713.165030:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019968 00000100:00100000:1.0:1787790713.165032:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019968 00000100:00100000:1.0:1787790713.165047:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790713.165052:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268019456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.165082:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268019456:12345-0@lo:400:kworker.0 Request processed in 30us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.165088:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790713.165098:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790713.165103:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268019968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.165123:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268019968:12345-0@lo:400:kworker.0 Request processed in 20us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.165136:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790713.165185:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268018560 00000100:00100000:1.0:1787790713.165188:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268018560 00000100:00100000:1.0:1787790713.165208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787790713.165213:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.165240:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268018560:12345-0@lo:400:kworker.0 Request processed in 27us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.165245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787790713.165266:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790713.165273:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268020224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790713.165294:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787790713.165329:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bcf00 x1874634268019456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.165351:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268019456:0@lo:400:kworker.0 00010000:00080000:1.0:1787790713.165361:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bcb40 x1874634268019968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.165369:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268019968:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.165418:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020224 00000100:00100000:1.0:1787790713.165421:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020224 00000100:00100000:1.0:1787790713.165442:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790713.165447:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268020224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790713.165468:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790713.165503:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268020224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.165509:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787790713.165534:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790713.165538:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790713.165541:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790713.165542:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787790713.165562:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e43c0 x1874634268020224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.165574:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268020224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790713.165915:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790713.165926:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268020352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790713.165957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790713.165984:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020352 00000100:00100000:0.0:1787790713.165989:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020352 00000100:00100000:0.0:1787790713.166020:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790713.166026:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268020352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790713.166039:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790713.166071:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268020352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790713.166077:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787790713.166101:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790713.166121:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bda40 x1874634268020352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790713.166134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268020352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790713.171078:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268018560:0@lo:400:kworker.0 00000100:00100000:3.0:1787790713.171096:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268019072:0@lo:400:kworker.0 00000100:00100000:3.0:1787790713.171159:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790713.171195:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268019584:0@lo:400:kworker.0 00000100:00100000:3.0:1787790713.171222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790713.171241:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268020096:0@lo:400:kworker.0 00000100:00100000:3.0:1787790713.171261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790713.171944:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019584 00000100:00100000:1.0:1787790713.171955:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019584 00000100:00100000:1.0:1787790713.172021:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020096 00000100:00100000:1.0:1787790713.172025:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020096 00000100:00100000:1.0:1787790713.172056:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790713.172068:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.172155:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268019584:12345-0@lo:400:kworker.0 Request processed in 88us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.172163:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787790713.172184:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790713.172191:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.172225:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268020096:12345-0@lo:400:kworker.0 Request processed in 35us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.172231:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787790713.172272:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bd680 x1874634268019584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.172289:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268019584:0@lo:400:kworker.0 00010000:00080000:1.0:1787790713.172302:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bc3c0 x1874634268020096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790713.172328:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268020096:0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.172477:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268019072 00000100:00100000:1.0:1787790713.172483:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268019072 00000100:00100000:1.0:1787790713.172516:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787790713.172523:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268019072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790713.172567:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268019072:12345-0@lo:400:kworker.0 Request processed in 45us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790713.172574:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787790713.172608:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268019072:0@lo:400:kworker.0 00000100:00080000:1.0:1787790713.172641:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790713.676454:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790714.237052:0:10689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787790714.701018:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790715.722984:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790715.723146:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790715.723191:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268020480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790715.723269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790715.723563:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020480 00000100:00100000:0.0:1787790715.723571:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020480 00000100:00100000:0.0:1787790715.723628:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787790715.723638:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268020480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790715.723668:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790715.723735:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268020480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790715.723742:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787790715.723798:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37e2940 x1874634268020480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790715.723815:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268020480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790715.724369:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790715.724385:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268020608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790715.724429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787790715.724468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790715.724526:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020608 00000100:00100000:2.0:1787790715.724531:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020608 00000100:00100000:2.0:1787790715.724580:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787790715.724588:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268020608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790715.724602:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790715.724640:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268020608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790715.724654:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787790715.725687:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790715.725784:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f5a40 x1874634268020608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790715.725805:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268020608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787790716.748226:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790716.748429:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790716.748461:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268020736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790716.748561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790716.748651:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020736 00000100:00100000:1.0:1787790716.748660:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020736 00000100:00100000:1.0:1787790716.748740:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787790716.748770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268020736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790716.748818:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790716.748876:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268020736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790716.748884:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787790716.749015:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268020736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790716.751363:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790716.751397:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268020864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790716.751500:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790716.751741:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020864 00000100:00100000:2.0:1787790716.751752:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020864 00000100:00100000:2.0:1787790716.751810:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787790716.751821:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268020864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790716.751879:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790716.751939:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268020864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790716.751947:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790716.752118:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268020864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790716.873434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790716.873491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790716.873596:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790716.873624:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133248 00000100:00100000:1.0:1787790716.873640:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133248 00000100:00100000:1.0:1787790716.873735:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 275 00000100:00100000:1.0:1787790716.873750:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2400:x1874634250133248:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790716.873757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133376 00000100:00100000:0.0:1787790716.873763:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133376 00000100:00100000:3.0:1787790716.873775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133504 00000100:00100000:3.0:1787790716.873781:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133504 00000100:00100000:0.0:1787790716.873820:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:3.0:1787790716.873830:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:0.0:1787790716.873832:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250133376:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790716.873845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2400:x1874634250133248:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 100us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790716.873853:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250133504:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790716.873858:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 275 00000100:00100000:0.0:1787790716.873882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250133376:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 53us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790716.873900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:3.0:1787790716.873910:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250133504:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 60us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790716.873920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00080000:0.0:1787790716.873920:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790716.873926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790716.874420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790716.874462:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790716.875067:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133632 00000100:00100000:0.0:1787790716.875075:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133632 00000100:00100000:0.0:1787790716.875339:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133760 00000100:00100000:0.0:1787790716.875344:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133760 00000100:00100000:1.0:1787790716.875405:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:1.0:1787790716.875418:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250133632:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790716.875500:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250133632:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 86us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790716.875509:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00080000:3.0:1787790716.875790:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790716.875794:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790716.876385:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:0.0:1787790716.876396:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250133760:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790716.876564:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250133760:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 169us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790716.876571:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00010000:00010000:2.0:1787790717.770883:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790718.282996:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268020992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790718.283102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283322:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268021376:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283387:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268021888:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283450:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268022400:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787790718.283499:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268021248:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283541:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268021760:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283563:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283579:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268022272:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.283636:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021376 00000100:00100000:1.0:1787790718.283644:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021376 00000100:00100000:1.0:1787790718.283728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790718.283739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268021376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283808:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268021376:12345-0@lo:400:kworker.0 Request processed in 69us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.283815:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790718.283842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021888 00000100:00100000:1.0:1787790718.283845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021888 00000100:00100000:1.0:1787790718.283882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022400 00000100:00100000:1.0:1787790718.283885:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022400 00000100:00100000:1.0:1787790718.283900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021248 00000100:00100000:1.0:1787790718.283902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021248 00000100:00100000:1.0:1787790718.283913:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021760 00000100:00100000:1.0:1787790718.283914:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021760 00000100:00100000:1.0:1787790718.283928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022272 00000100:00100000:1.0:1787790718.283930:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022272 00000100:00100000:1.0:1787790718.283944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787790718.283949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268021888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.283997:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268021888:12345-0@lo:400:kworker.0 Request processed in 47us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284003:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787790718.284019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787790718.284025:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268022400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268022400:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787790718.284068:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787790718.284074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268021248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284100:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268021248:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787790718.284116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787790718.284121:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268021760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268021760:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787790718.284165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787790718.284170:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268022272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268022272:12345-0@lo:400:kworker.0 Request processed in 25us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787790718.284237:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790718.284242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790718.284266:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268021504:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.284356:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268022016:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.284404:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268022528:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.284446:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787790718.284453:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268021120:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.284508:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268021632:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.284544:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268022144:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790718.284595:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022016 00000100:00100000:1.0:1787790718.284600:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022016 00000100:00100000:1.0:1787790718.284636:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022528 00000100:00100000:1.0:1787790718.284639:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022528 00000100:00100000:1.0:1787790718.284654:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022144 00000100:00100000:1.0:1787790718.284656:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022144 00000100:00100000:1.0:1787790718.284672:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790718.284680:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268022016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284742:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268022016:12345-0@lo:400:kworker.0 Request processed in 64us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284749:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790718.284761:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790718.284767:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268022528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284820:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268022528:12345-0@lo:400:kworker.0 Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284826:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790718.284838:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790718.284843:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268022144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284868:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268022144:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284873:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790718.284899:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021120 00000100:00100000:1.0:1787790718.284902:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021120 00000100:00100000:1.0:1787790718.284934:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787790718.284940:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268021120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.284970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268021120:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.284975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1787790718.285012:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790718.285016:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790718.285055:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268021248:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.285069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268021760:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.285079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268022272:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.285090:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268021376:0@lo:400:kworker.0 00010000:00080000:1.0:1787790718.285105:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bc3c0 x1874634268021888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.285117:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268021888:0@lo:400:kworker.0 00010000:00080000:1.0:1787790718.285137:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bcf00 x1874634268022400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.285146:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268022400:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.285181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021632 00000100:00100000:1.0:1787790718.285185:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021632 00000100:00100000:1.0:1787790718.285209:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787790718.285214:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268021632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.285245:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268021632:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790718.285251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787790718.285276:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268021120:0@lo:400:kworker.0 00000100:00100000:1.0:1787790718.285301:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268021632:0@lo:400:kworker.0 00010000:00080000:1.0:1787790718.285313:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37be1c0 x1874634268022144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.285322:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268022144:0@lo:400:kworker.0 00010000:00080000:1.0:1787790718.285333:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bd680 x1874634268022016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.285341:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268022016:0@lo:400:kworker.0 00010000:00080000:1.0:1787790718.285351:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37be940 x1874634268022528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.285359:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268022528:0@lo:400:kworker.0 00000100:00100000:0.0:1787790718.285548:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268020992 00000100:00100000:0.0:1787790718.285553:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268020992 00000100:00100000:0.0:1787790718.285597:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790718.285604:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268020992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790718.285632:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790718.285674:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268020992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790718.285681:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790718.285739:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268021504 00000100:00100000:0.0:1787790718.285744:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268021504 00000100:00100000:0.0:1787790718.285772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787790718.285779:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268021504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790718.285815:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268021504:12345-0@lo:400:kworker.0 Request processed in 36us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790718.285834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787790718.285858:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790718.285936:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268021504:0@lo:400:kworker.0 00010000:00080000:1.0:1787790718.285959:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bde00 x1874634268020992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790718.285974:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268020992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790718.285991:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790718.286000:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268022656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790718.286031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790718.286197:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022656 00000100:00100000:0.0:1787790718.286202:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022656 00000100:00100000:0.0:1787790718.286235:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790718.286242:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268022656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790718.286254:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790718.286309:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268022656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790718.286316:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787790718.286382:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bda40 x1874634268022656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790718.286396:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268022656:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787790718.794871:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787790719.310262:0:10932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing yml_node 00010000:00010000:3.0:1787790719.822013:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790720.842876:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790720.843744:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790720.843835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790720.844302:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022784 00000100:00100000:2.0:1787790720.844310:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022784 00000100:00100000:2.0:1787790720.844369:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787790720.844379:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268022784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790720.844407:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787790720.844496:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790720.844588:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268022784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790720.844595:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787790720.844666:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37e21c0 x1874634268022784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790720.844684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790720.846553:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268022912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790720.846625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790720.846909:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268022912 00000100:00100000:2.0:1787790720.846918:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268022912 00000100:00100000:2.0:1787790720.846996:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787790720.847006:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268022912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790720.847034:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790720.847096:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268022912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790720.847103:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787790720.847361:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790720.847395:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc308a580 x1874634268022912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790720.847483:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268022912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790721.867573:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790721.867599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268023040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790721.867664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790721.867905:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790721.867936:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023040 00000100:00100000:2.0:1787790721.867955:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023040 00000100:00100000:2.0:1787790721.867999:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787790721.868006:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268023040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790721.868039:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787790721.868083:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268023040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790721.868090:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787790721.868145:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268023040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790721.880514:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268023168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790721.880590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790721.880736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023168 00000100:00100000:0.0:1787790721.880744:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023168 00000100:00100000:0.0:1787790721.880798:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790721.880808:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268023168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790721.880842:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790721.880921:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268023168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790721.880928:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790721.880985:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268023168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790722.010130:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790722.010181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790722.010211:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790722.010228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790722.010266:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790722.010296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134144 00000100:00100000:3.0:1787790722.010305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134144 00000100:00100000:3.0:1787790722.010368:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134016 00000100:00100000:3.0:1787790722.010372:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134016 00000100:00100000:0.0:1787790722.010389:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134272 00000100:00100000:0.0:1787790722.010395:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134272 00000100:00100000:3.0:1787790722.010399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 77 00000100:00100000:3.0:1787790722.010423:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3088b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250134144:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790722.010432:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134400 00000100:00100000:0.0:1787790722.010437:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134400 00000100:00100000:0.0:1787790722.010463:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:0.0:1787790722.010472:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3089e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2399:x1874634250134272:12345-192.168.202.22@tcp:9:kworker.0 00000100:00100000:3.0:1787790722.010498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3088b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250134144:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790722.010507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 77 00000020:00000080:0.0:1787790722.010511:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d9e8 00000100:00080000:0.0:1787790722.010525:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9170f6791000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787790722.010530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:3.0:1787790722.010540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250134016:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790722.010566:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250134016:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790722.010593:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 78 00000001:00000004:0.0:1787790722.010606:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787790722.010616:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787790722.010624:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2399:x1874634250134400:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:3.0:1787790722.010644:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d9ef 00000100:00080000:3.0:1787790722.010654:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170f6790800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790722.010682:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787790722.010826:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+2:2399:x1874634250134400:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 202us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790722.010834:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00080000:3.0:1787790722.010958:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790722.010963:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790722.010966:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790722.010968:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790722.011049:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3089e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+2:2399:x1874634250134272:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 578us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790722.011058:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00010000:00010000:3.0:1787790722.011087:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790722.012374:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250133888 00000100:00100000:2.0:1787790722.012383:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250133888 00000100:00100000:2.0:1787790722.012439:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 277 00000100:00100000:2.0:1787790722.012449:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250133888:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790722.012629:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250133888:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 180us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790722.012637:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 277 00010000:00010000:1.0:1787790722.012644:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790722.891021:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787790723.285602:0:11116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.50 00000100:00100000:3.0:1787790723.406510:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268023424:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790723.406598:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268023296:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.406636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406639:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268023936:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790723.406661:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268023808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268024448:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.406680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790723.406697:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268024320:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406747:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268023552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406774:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790723.406797:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406803:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268024064:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.406815:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268024832:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406853:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268024576:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.406857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406884:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787790723.406889:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023296 00000100:00100000:3.0:1787790723.406890:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268023680:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.406896:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023296 00000100:00100000:3.0:1787790723.406925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790723.406942:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787790723.406944:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268024192:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.406964:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268023296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.406980:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268024704:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.406998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790723.407008:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268023296:12345-0@lo:400:kworker.0 Request processed in 59us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790723.407015:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787790723.407022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023424 00000100:00100000:3.0:1787790723.407025:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023424 00000100:00100000:2.0:1787790723.407045:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023936 00000100:00100000:3.0:1787790723.407046:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023808 00000100:00100000:3.0:1787790723.407048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023808 00000100:00100000:2.0:1787790723.407048:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023936 00000100:00100000:3.0:1787790723.407057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024448 00000100:00100000:3.0:1787790723.407059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024448 00000100:00100000:3.0:1787790723.407069:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024064 00000100:00100000:2.0:1787790723.407069:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024576 00000100:00100000:3.0:1787790723.407071:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024064 00000100:00100000:2.0:1787790723.407072:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024576 00000100:00100000:3.0:1787790723.407084:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790723.407089:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268023424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.407212:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268023424:12345-0@lo:400:kworker.0 Request processed in 122us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.408591:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790723.408609:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268025088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790723.408659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790723.408726:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025088 00000100:00100000:0.0:1787790723.408733:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025088 00000100:00100000:0.0:1787790723.408779:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787790723.409656:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787790723.409669:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268023808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.409740:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268023808:12345-0@lo:400:kworker.0 Request processed in 75us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790723.409748:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787790723.409771:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787790723.409778:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268023936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790723.410484:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268025088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790723.410513:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790723.410567:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268025088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1780us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.410574:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787790723.410631:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bcf00 x1874634268025088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790723.410653:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268025088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790723.410750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790723.410770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790723.410779:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268024448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.410963:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268024448:12345-0@lo:400:kworker.0 Request processed in 185us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.410970:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790723.410990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790723.410997:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268024064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.411027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268024064:12345-0@lo:400:kworker.0 Request processed in 32us (4201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.411033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790723.411044:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790723.411050:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268024576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.411076:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268024576:12345-0@lo:400:kworker.0 Request processed in 27us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.411081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790723.411110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023552 00000100:00100000:3.0:1787790723.411115:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023552 00000100:00100000:3.0:1787790723.411148:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268023680 00000100:00100000:3.0:1787790723.411152:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268023680 00000100:00100000:3.0:1787790723.411167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790723.411174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268023552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.411210:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268023552:12345-0@lo:400:kworker.0 Request processed in 36us (4435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.411215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790723.411226:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787790723.411233:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268023680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.411289:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268023680:12345-0@lo:400:kworker.0 Request processed in 56us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.411296:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787790723.411316:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024320 00000100:00100000:3.0:1787790723.411320:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024320 00000100:00100000:3.0:1787790723.411340:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024832 00000100:00100000:3.0:1787790723.411348:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024832 00000100:00100000:3.0:1787790723.411365:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024192 00000100:00100000:3.0:1787790723.411367:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024192 00000100:00100000:3.0:1787790723.411379:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024704 00000100:00100000:3.0:1787790723.411382:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024704 00000100:00080000:0.0:1787790723.411766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790723.411771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787790723.411774:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790723.411776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790723.411890:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790723.411901:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268024320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790723.411941:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268024320:12345-0@lo:400:kworker.0 Request processed in 44us (5151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.411946:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790723.412081:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790723.412087:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268024832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790723.412110:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268024832:12345-0@lo:400:kworker.0 Request processed in 23us (5251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.412115:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790723.412125:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790723.412130:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3797840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268024192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790723.412151:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3797840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268024192:12345-0@lo:400:kworker.0 Request processed in 22us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790723.412156:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787790723.412260:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790723.412269:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3795a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268024704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.412301:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3795a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268024704:12345-0@lo:400:kworker.0 Request processed in 34us (5302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.412306:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790723.412334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268024960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790723.412368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790723.412923:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268023424:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.412938:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268024448:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.412971:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268024960 00000100:00100000:3.0:1787790723.412976:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268024960 00000100:00100000:3.0:1787790723.413007:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790723.413013:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268024960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790723.413029:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790723.413068:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268024960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790723.413075:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787790723.413106:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bc3c0 x1874634268024960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790723.413122:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268024960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790723.413148:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268023680:0@lo:400:kworker.0 00010000:00080000:3.0:1787790723.413173:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373d2c0 x1874634268024192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790723.413182:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268024192:0@lo:400:kworker.0 00010000:00080000:3.0:1787790723.413191:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe64b40 x1874634268024704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790723.413198:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268024704:0@lo:400:kworker.0 00000100:00100000:3.0:1787790723.413208:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268023552:0@lo:400:kworker.0 00010000:00080000:3.0:1787790723.413219:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f480 x1874634268024064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790723.413227:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268024064:0@lo:400:kworker.0 00010000:00080000:3.0:1787790723.413238:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe65a40 x1874634268024576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790723.413257:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268024576:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.413582:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268023936:12345-0@lo:400:kworker.0 Request processed in 3803us (6920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790723.413591:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787790723.413643:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268023296:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.413657:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268023808:0@lo:400:kworker.0 00010000:00080000:2.0:1787790723.413668:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f0c0 x1874634268024320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790723.413686:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268023936:0@lo:400:kworker.0 00000100:00100000:2.0:1787790723.413689:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268024320:0@lo:400:kworker.0 00010000:00080000:2.0:1787790723.413699:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbf19a40 x1874634268024832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790723.413721:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268024832:0@lo:400:kworker.0 00010000:00010000:0.0:1787790723.916854:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790724.944546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787790725.349403:0:11213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.50 00010000:00010000:1.0:1787790725.963466:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790725.963628:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268025216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790725.963722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790725.963793:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025216 00000100:00100000:1.0:1787790725.963801:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025216 00000100:00100000:1.0:1787790725.963853:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787790725.963862:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268025216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790725.963896:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790725.963941:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268025216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790725.963957:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787790725.963979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790725.964009:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a80f00 x1874634268025216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790725.964027:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268025216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790725.967345:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790725.967369:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268025344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790725.967442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790725.967499:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025344 00000100:00100000:3.0:1787790725.967507:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025344 00000100:00100000:3.0:1787790725.967576:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787790725.967585:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268025344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787790725.967610:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790725.967655:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268025344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790725.967670:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787790725.967727:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37961c0 x1874634268025344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790725.967747:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268025344:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787790725.968187:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790726.986965:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790726.986998:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268025472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790726.987100:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790726.987421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025472 00000100:00100000:1.0:1787790726.987431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025472 00000100:00100000:1.0:1787790726.987696:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787790726.987728:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268025472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790726.987767:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790726.987830:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268025472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790726.987837:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787790726.988109:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790726.988120:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268025600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790726.988181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790726.988220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025600 00000100:00100000:0.0:1787790726.988225:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025600 00000100:00100000:0.0:1787790726.988252:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787790726.988260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268025600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790726.988279:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787790726.988316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268025600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790726.988323:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787790726.988361:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268025600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790726.988608:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268025472:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787790726.988671:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790727.117225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790727.117696:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134528 00000100:00100000:2.0:1787790727.117735:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134528 00000100:00100000:2.0:1787790727.117880:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 279 00000100:00100000:2.0:1787790727.117893:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2402:x1874634250134528:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790727.118087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2402:x1874634250134528:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 196us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790727.118095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 279 00000100:00100000:3.0:1787790727.124201:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790727.124340:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790727.124389:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134656 00000100:00100000:3.0:1787790727.124398:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134656 00000100:00100000:3.0:1787790727.124465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134784 00000100:00100000:3.0:1787790727.124469:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134784 00000100:00100000:3.0:1787790727.124524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 85 00000100:00100000:3.0:1787790727.124536:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250134656:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790727.124607:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250134656:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 73us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790727.124615:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 85 00000100:00100000:3.0:1787790727.124633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00100000:3.0:1787790727.124638:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250134784:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790727.124662:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250134784:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790727.124668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00080000:3.0:1787790727.124688:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790727.124692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787790727.792061:0:11311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.50 00010000:00010000:1.0:1787790728.012413:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787790728.014507:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:3.0:1787790728.014519:0:8420:0:(genops.c:885:class_export_put()) final put ffff9170fbdf6000/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:1.0:1787790728.015427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170fbdf6000/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-OST0000 00000020:00000080:1.0:1787790728.015553:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f6791000 for lustre-OST0000 00000001:00100000:0.0:1787790728.015671:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:0.0:1787790728.015700:0:9504:0:(genops.c:885:class_export_put()) final put ffff9170f6790000/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:1.0:1787790728.015865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f6790000/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-OST0001 00000020:00000080:1.0:1787790728.015888:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f6790800 for lustre-OST0001 00000100:00100000:1.0:1787790728.523035:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790728.523059:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268025728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790728.523163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790728.523654:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025728 00000100:00100000:3.0:1787790728.523662:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025728 00000100:00100000:3.0:1787790728.523746:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790728.523757:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268025728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790728.523787:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790728.523837:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268025728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790728.523845:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787790728.523868:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790728.523900:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26be1c0 x1874634268025728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790728.523918:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268025728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790728.524295:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790728.524306:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268025856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790728.524340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790728.524510:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025856 00000100:00100000:1.0:1787790728.524515:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025856 00000100:00100000:1.0:1787790728.524559:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790728.524581:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268025856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790728.524594:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790728.524642:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268025856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790728.524649:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790728.524784:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268025984:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.524814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790728.524834:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268026496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.524858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790728.524874:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268027008:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.524893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787790728.524917:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26be1c0 x1874634268025856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790728.524931:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268025856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790728.524946:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787790728.524952:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268026368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.524976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790728.524992:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268026880:0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.525277:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268026240:0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.525359:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268026112:0@lo:400:kworker.0 00000100:00080000:0.0:1787790728.525407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790728.525453:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027008 00000100:00100000:0.0:1787790728.525458:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027008 00000100:00100000:0.0:1787790728.525515:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787790728.525524:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268027008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.526914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790728.526962:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268026752:0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.526993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790728.527027:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268027264:0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790728.527099:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268025984 00000100:00100000:2.0:1787790728.527106:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268025984 00000100:00100000:2.0:1787790728.527148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787790728.527157:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268025984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527213:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268025984:12345-0@lo:400:kworker.0 Request processed in 58us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.527240:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787790728.527278:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026496 00000100:00100000:2.0:1787790728.527281:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026496 00000100:00100000:2.0:1787790728.527307:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026752 00000100:00100000:2.0:1787790728.527310:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026752 00000100:00100000:2.0:1787790728.527332:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027264 00000100:00100000:2.0:1787790728.527335:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027264 00000100:00100000:2.0:1787790728.527351:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787790728.527357:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268026496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527397:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268026496:12345-0@lo:400:kworker.0 Request processed in 39us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.527404:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787790728.527415:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787790728.527420:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3716d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527452:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3716d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268026752:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.527458:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787790728.527468:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787790728.527474:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268027264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527511:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268027264:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.527517:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1787790728.527550:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a80f00 x1874634268026752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790728.527562:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268026752:0@lo:400:kworker.0 00010000:00080000:2.0:1787790728.527573:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a82940 x1874634268027264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790728.527590:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268027264:0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527883:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026368 00000100:00100000:2.0:1787790728.527888:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026368 00000100:00100000:2.0:1787790728.527913:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026240 00000100:00100000:2.0:1787790728.527916:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026240 00000100:00100000:2.0:1787790728.527928:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790728.527935:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268026368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.527973:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268026368:12345-0@lo:400:kworker.0 Request processed in 38us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.527979:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790728.527990:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787790728.527996:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268026240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.528030:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268026240:12345-0@lo:400:kworker.0 Request processed in 33us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.528035:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787790728.528048:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790728.528053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790728.528069:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268026240:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.528783:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790728.528822:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268025984:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.528837:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268026496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790728.528866:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268026368:0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.528968:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026880 00000100:00100000:2.0:1787790728.528974:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026880 00000100:00100000:2.0:1787790728.529031:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787790728.529039:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268026880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790728.529083:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268026880:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790728.529089:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790728.529290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790728.529322:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268026624:0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790728.529367:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268027136:0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790728.529419:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026112 00000100:00100000:3.0:1787790728.529422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026112 00000100:00100000:3.0:1787790728.529446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268026624 00000100:00100000:3.0:1787790728.529449:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268026624 00000100:00100000:3.0:1787790728.529467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027136 00000100:00100000:3.0:1787790728.529470:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027136 00000100:00100000:3.0:1787790728.529495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787790728.529514:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268026112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529552:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268026112:12345-0@lo:400:kworker.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790728.529558:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787790728.529571:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787790728.529577:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268026624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529603:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268026624:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790728.529620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787790728.529632:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787790728.529638:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268027136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268027136:12345-0@lo:400:kworker.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790728.529681:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787790728.529731:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268026112:0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529741:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268026624:0@lo:400:kworker.0 00000100:00100000:3.0:1787790728.529748:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268027136:0@lo:400:kworker.0 00000100:00080000:1.0:1787790728.530097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790728.530110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790728.530247:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a82d00 x1874634268026880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790728.530258:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268026880:0@lo:400:kworker.0 00000100:00100000:0.0:1787790728.530447:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268027008:12345-0@lo:400:kworker.0 Request processed in 4923us (5550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790728.530456:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787790728.532999:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a821c0 x1874634268027008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790728.533030:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268027008:0@lo:400:kworker.0 00010000:00010000:0.0:1787790729.035087:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787790729.632157:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 20:32:09 EDT 2026 00010000:00010000:1.0:1787790730.059742:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790731.083040:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790731.083570:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790731.083599:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268027392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790731.083692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790731.084249:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027392 00000100:00100000:1.0:1787790731.084263:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027392 00000100:00080000:0.0:1787790731.084405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790731.084450:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790731.084463:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268027520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790731.084501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790731.084536:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027520 00000100:00100000:2.0:1787790731.084541:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027520 00000100:00100000:1.0:1787790731.084611:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787790731.084622:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268027392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787790731.084662:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790731.084738:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268027392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790731.084745:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787790731.084882:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790731.084916:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bf480 x1874634268027392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790731.084947:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268027392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790731.087948:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790731.087977:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268027520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790731.088024:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790731.088149:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268027520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790731.088158:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787790731.088240:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3714780 x1874634268027520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790731.088266:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268027520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790732.107298:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790732.107490:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790732.107515:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268027648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790732.107586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790732.107757:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027648 00000100:00100000:2.0:1787790732.107764:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027648 00000100:00100000:2.0:1787790732.107812:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787790732.107819:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268027648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790732.107849:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787790732.107895:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268027648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790732.107901:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787790732.108060:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268027648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790732.108252:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790732.108262:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268027776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790732.108287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790732.108396:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027776 00000100:00100000:1.0:1787790732.108399:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027776 00000100:00100000:1.0:1787790732.108424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787790732.108429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268027776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790732.108444:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790732.108472:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268027776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790732.108482:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787790732.108512:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268027776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790732.231853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790732.231916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790732.232002:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250134912 00000100:00100000:2.0:1787790732.232012:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250134912 00000100:00100000:2.0:1787790732.232062:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 281 00000100:00100000:2.0:1787790732.232070:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2400:x1874634250134912:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790732.232141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2400:x1874634250134912:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790732.232149:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 281 00000100:00100000:3.0:1787790732.232315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135040 00000100:00100000:3.0:1787790732.232319:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135040 00000100:00100000:3.0:1787790732.232373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 93 00000100:00100000:3.0:1787790732.232379:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250135040:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790732.232407:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250135040:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790732.232412:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 93 00000100:00080000:1.0:1787790732.232588:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790732.234352:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790732.234426:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135168 00000100:00100000:2.0:1787790732.234434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135168 00000100:00100000:2.0:1787790732.234487:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 94 00000100:00100000:2.0:1787790732.234497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250135168:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790732.234572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250135168:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790732.234580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 94 00000100:00080000:1.0:1787790732.234728:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787790733.131214:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790733.646558:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268028032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.646675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790733.646796:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790733.646805:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268027904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790733.646844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790733.646894:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790733.646905:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268028160:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.646938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790733.646987:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268027904 00000100:00100000:0.0:1787790733.646996:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268027904 00000100:00100000:0.0:1787790733.647073:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787790733.647084:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268027904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790733.647127:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790733.647196:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268027904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.647204:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787790733.647258:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bc3c0 x1874634268027904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790733.647284:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268027904:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787790733.647334:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790733.647366:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028160 00000100:00100000:0.0:1787790733.647370:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028160 00000100:00100000:0.0:1787790733.647412:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787790733.647436:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268028160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.647478:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268028160:12345-0@lo:400:kworker.0 Request processed in 44us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.647486:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787790733.647507:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028032 00000100:00100000:0.0:1787790733.647511:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028032 00000100:00100000:0.0:1787790733.647538:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787790733.647545:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268028032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.647581:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268028032:12345-0@lo:400:kworker.0 Request processed in 37us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.647587:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787790733.647627:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268028160:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.647653:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268028032:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.648025:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268028672:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.648065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.648091:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268029184:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.648114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.648136:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787790733.648143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268028288:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.648183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.648203:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268028800:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.648226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.648246:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268029312:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.648268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790733.651433:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028672 00000100:00100000:0.0:1787790733.651448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028672 00000100:00100000:0.0:1787790733.651514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029184 00000100:00100000:0.0:1787790733.651518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029184 00000100:00100000:0.0:1787790733.651533:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028800 00000100:00100000:0.0:1787790733.651536:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028800 00000100:00100000:0.0:1787790733.651551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029312 00000100:00100000:0.0:1787790733.651554:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029312 00000100:00100000:0.0:1787790733.651574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787790733.651585:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268028672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.651718:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268028672:12345-0@lo:400:kworker.0 Request processed in 119us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.651727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787790733.651748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787790733.651764:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268029184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.651798:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268029184:12345-0@lo:400:kworker.0 Request processed in 35us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.651805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787790733.651816:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790733.651822:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268028800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.651850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268028800:12345-0@lo:400:kworker.0 Request processed in 29us (3624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.651857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790733.651867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787790733.651873:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268029312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.651898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268029312:12345-0@lo:400:kworker.0 Request processed in 25us (3628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.651904:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1787790733.652408:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790733.652415:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790733.652453:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028288 00000100:00100000:0.0:1787790733.652459:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028288 00000100:00100000:0.0:1787790733.652493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787790733.652501:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268028288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.652549:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268028288:12345-0@lo:400:kworker.0 Request processed in 49us (4366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.652556:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787790733.652630:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268028288:0@lo:400:kworker.0 00010000:00080000:0.0:1787790733.652650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e4000 x1874634268028800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790733.652677:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268028800:0@lo:400:kworker.0 00010000:00080000:0.0:1787790733.652694:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39f1680 x1874634268029312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790733.652703:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268029312:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.652751:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268028672:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.652763:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268029184:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.652826:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268028416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.652875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.653260:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268028544:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.653316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.653342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268029056:0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.653370:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.653391:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268029568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790733.653419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790733.653467:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029056 00000100:00100000:1.0:1787790733.653473:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029056 00000100:00100000:1.0:1787790733.653524:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787790733.653533:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268029056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.653580:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268029056:12345-0@lo:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790733.653587:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787790733.653612:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029568 00000100:00100000:1.0:1787790733.653616:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029568 00000100:00100000:1.0:1787790733.653648:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787790733.653655:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268029568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790733.653677:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790733.653735:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268029568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790733.653742:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787790733.653763:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790733.653766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790733.653794:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e7480 x1874634268029056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790733.653806:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268029056:0@lo:400:kworker.0 00010000:00080000:1.0:1787790733.653815:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37152c0 x1874634268029568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790733.653828:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268029568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790733.653850:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028544 00000100:00100000:1.0:1787790733.653854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028544 00000100:00100000:1.0:1787790733.653882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787790733.653888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268028544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790733.653947:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268028544:12345-0@lo:400:kworker.0 Request processed in 59us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790733.653954:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787790733.653984:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268028544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.654244:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268028928:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.654283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790733.654382:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268029440:0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.654407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790733.654446:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028928 00000100:00100000:0.0:1787790733.654450:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028928 00000100:00100000:0.0:1787790733.654481:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029440 00000100:00100000:0.0:1787790733.654484:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029440 00000100:00100000:0.0:1787790733.654500:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790733.654506:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268028928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.654544:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268028928:12345-0@lo:400:kworker.0 Request processed in 38us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.654552:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787790733.654566:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787790733.654572:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268029440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790733.654614:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268029440:12345-0@lo:400:kworker.0 Request processed in 42us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790733.654621:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787790733.654651:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e6940 x1874634268028928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790733.654662:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268028928:0@lo:400:kworker.0 00010000:00080000:0.0:1787790733.654671:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39f0000 x1874634268029440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790733.654679:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268029440:0@lo:400:kworker.0 00000100:00080000:1.0:1787790733.655174:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790733.655259:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268028416 00000100:00100000:3.0:1787790733.655266:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268028416 00000100:00100000:3.0:1787790733.655317:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790733.655327:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268028416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790733.655398:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268028416:12345-0@lo:400:kworker.0 Request processed in 73us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790733.655404:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787790733.655562:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268028416:0@lo:400:kworker.0 00010000:00010000:2.0:1787790734.155045:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790735.183933:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790736.204155:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268029696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790736.204249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790736.204377:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029696 00000100:00100000:2.0:1787790736.204387:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029696 00000100:00100000:2.0:1787790736.204473:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787790736.204484:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268029696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790736.204521:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790736.204570:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268029696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790736.204577:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787790736.204629:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790736.204663:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3714780 x1874634268029696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790736.204688:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268029696:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787790736.205189:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790736.205385:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790736.205400:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268029824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790736.205443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790736.205527:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029824 00000100:00100000:1.0:1787790736.205533:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029824 00000100:00100000:1.0:1787790736.205579:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787790736.205587:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268029824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790736.205603:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790736.205644:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268029824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790736.205650:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787790736.205681:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39f3c00 x1874634268029824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790736.205695:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268029824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790736.205766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790737.226872:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268029952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790737.226959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790737.227033:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268029952 00000100:00100000:1.0:1787790737.227040:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268029952 00000100:00100000:1.0:1787790737.227104:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787790737.227113:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268029952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790737.227163:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790737.227225:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268029952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790737.227232:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787790737.227278:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268029952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787790737.228661:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790737.228910:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268030080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790737.228968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790737.229209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030080 00000100:00100000:0.0:1787790737.229216:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030080 00000100:00100000:0.0:1787790737.229275:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787790737.229284:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268030080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790737.229317:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787790737.229372:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268030080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790737.229379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787790737.229878:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268030080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790737.349408:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790737.349467:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790737.349501:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790737.349607:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135424 00000100:00100000:0.0:1787790737.349625:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135424 00000100:00100000:2.0:1787790737.349656:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135552 00000100:00100000:2.0:1787790737.349666:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135552 00000100:00100000:1.0:1787790737.349811:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135296 00000100:00100000:1.0:1787790737.349818:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135296 00000100:00080000:3.0:1787790737.349907:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790737.349913:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790737.354422:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 101 00000100:00100000:2.0:1787790737.354461:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250135424:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790737.354588:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250135424:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 150us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.354597:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 101 00000100:00100000:2.0:1787790737.354624:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:2.0:1787790737.354632:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250135552:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790737.354664:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250135552:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 34us (5163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790737.354670:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:1.0:1787790737.356887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 283 00000100:00100000:1.0:1787790737.356913:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2402:x1874634250135296:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790737.357010:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2402:x1874634250135296:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 110us (7542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790737.357018:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 283 00010000:00010000:2.0:1787790738.251922:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790738.763202:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268030208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790738.763333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.763396:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030208 00000100:00100000:3.0:1787790738.763408:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030208 00000100:00100000:3.0:1787790738.763508:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787790738.763523:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268030208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790738.763571:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790738.765824:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268030208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2281us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790738.765862:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787790738.765916:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790738.766142:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268030336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790738.766236:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790738.766573:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030336 00000100:00100000:1.0:1787790738.766583:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030336 00000100:00100000:1.0:1787790738.766660:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787790738.766672:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268030336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790738.766732:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790738.766791:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268030336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790738.766798:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787790738.766921:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787790738.767071:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e5680 x1874634268030336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790738.767097:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268030336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790738.767408:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00080000:2.0:1787790738.767549:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e6940 x1874634268030208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790738.767568:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268030208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790738.767637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268030592:0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.767692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.767815:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268030464:0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.767864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.767911:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030464 00000100:00100000:3.0:1787790738.767917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030464 00000100:00100000:3.0:1787790738.767965:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787790738.767974:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.768221:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268030464:12345-0@lo:400:kworker.0 Request processed in 246us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790738.768229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787790738.768353:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268030464:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.768588:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268030848:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.768621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790738.768643:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268031360:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.768665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790738.768684:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787790738.768689:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268030720:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.768731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790738.768748:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268031232:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.768773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.768829:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268030976:0@lo:400:kworker.0 00000100:00100000:1.0:1787790738.768942:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268031104:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.769149:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268031744:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.769176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790738.769257:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030592 00000100:00100000:2.0:1787790738.769264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030592 00000100:00100000:2.0:1787790738.769314:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031232 00000100:00100000:2.0:1787790738.769318:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031232 00000100:00100000:2.0:1787790738.769353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787790738.769362:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268030592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790738.769417:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268030592:12345-0@lo:400:kworker.0 Request processed in 56us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790738.769442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787790738.769459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787790738.769465:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268031232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790738.769496:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268031232:12345-0@lo:400:kworker.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790738.769502:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787790738.769523:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787790738.769699:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e6580 x1874634268031232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790738.769735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268031232:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.769763:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030848 00000100:00100000:0.0:1787790738.769766:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030848 00000100:00100000:0.0:1787790738.769793:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030720 00000100:00100000:0.0:1787790738.769796:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030720 00000100:00100000:0.0:1787790738.769815:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787790738.769831:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268030848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.769868:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268030848:12345-0@lo:400:kworker.0 Request processed in 37us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790738.769874:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787790738.769885:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787790738.769890:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268030720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.769911:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268030720:12345-0@lo:400:kworker.0 Request processed in 22us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790738.769917:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787790738.769933:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031360 00000100:00100000:0.0:1787790738.769936:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031360 00000100:00100000:0.0:1787790738.769965:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790738.769971:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268031360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790738.770197:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031744 00000100:00100000:2.0:1787790738.770201:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031744 00000100:00100000:2.0:1787790738.770224:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031104 00000100:00100000:2.0:1787790738.770227:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031104 00000100:00100000:2.0:1787790738.770242:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790738.770257:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268031744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770380:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268031616:0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.770436:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268030592:0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031616 00000100:00100000:3.0:1787790738.770466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031616 00000100:00100000:3.0:1787790738.770484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787790738.770490:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268031104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770523:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268031104:12345-0@lo:400:kworker.0 Request processed in 33us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790738.770537:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787790738.770548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787790738.770553:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3794b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268031616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770575:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3794b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268031616:12345-0@lo:400:kworker.0 Request processed in 23us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790738.770581:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787790738.770608:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268031104:0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.770617:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268031616:0@lo:400:kworker.0 00000100:00100000:2.0:1787790738.770933:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268031744:12345-0@lo:400:kworker.0 Request processed in 684us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790738.770941:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787790738.770962:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790738.770965:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790738.770968:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790738.771137:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268030720:0@lo:400:kworker.0 00010000:00080000:1.0:1787790738.771162:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe643c0 x1874634268031744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790738.771173:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268031744:0@lo:400:kworker.0 00000100:00100000:1.0:1787790738.771184:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268030848:0@lo:400:kworker.0 00000100:00100000:2.0:1787790738.771315:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790738.771351:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268031488:0@lo:400:kworker.0 00000100:00100000:2.0:1787790738.771385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790738.771453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268030976 00000100:00100000:3.0:1787790738.771457:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268030976 00000100:00100000:3.0:1787790738.771493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787790738.771501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790738.771545:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268030976:12345-0@lo:400:kworker.0 Request processed in 45us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790738.771552:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787790738.771601:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031488 00000100:00100000:1.0:1787790738.771605:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031488 00000100:00100000:1.0:1787790738.771647:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787790738.771653:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268031488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790738.771685:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268031488:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790738.771691:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787790738.771803:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790738.771918:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268030976:0@lo:400:kworker.0 00010000:00080000:2.0:1787790738.771930:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe65a40 x1874634268031488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790738.771940:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268031488:0@lo:400:kworker.0 00000100:00100000:0.0:1787790738.772146:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268031360:12345-0@lo:400:kworker.0 Request processed in 2174us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790738.772154:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787790738.772209:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bc3c0 x1874634268031360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790738.772220:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268031360:0@lo:400:kworker.0 00010000:00010000:1.0:1787790739.275111:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790740.303067:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790741.325532:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790741.326139:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790741.326166:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268031872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790741.327443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790741.327563:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268031872 00000100:00100000:0.0:1787790741.327573:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268031872 00000100:00100000:0.0:1787790741.327647:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790741.327661:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268031872:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790741.328119:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268032000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790741.328176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787790741.328813:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790741.328951:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268031872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1293us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790741.328968:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790741.329000:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032000 00000100:00100000:0.0:1787790741.329005:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032000 00000100:00100000:0.0:1787790741.329040:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790741.329047:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268032000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790741.334992:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790741.335232:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268032000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6170us (7039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790741.335247:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787790741.335305:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790741.335364:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbebc780 x1874634268031872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790741.335392:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268031872:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787790741.342609:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39f03c0 x1874634268032000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790741.342645:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268032000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790742.347737:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268032128:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787790742.347768:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790742.347821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790742.347929:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032128 00000100:00100000:1.0:1787790742.347941:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032128 00000100:00100000:1.0:1787790742.348014:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787790742.348050:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268032128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790742.348118:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790742.348212:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268032128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790742.348220:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790742.348341:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268032128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790742.348737:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268032256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790742.348783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790742.348940:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032256 00000100:00100000:0.0:1787790742.348946:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032256 00000100:00100000:0.0:1787790742.348989:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787790742.348997:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268032256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790742.349022:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790742.349084:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268032256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790742.349092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787790742.349129:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268032256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790742.471837:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790742.471894:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790742.471954:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135680 00000100:00100000:2.0:1787790742.471970:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135680 00000100:00100000:3.0:1787790742.471995:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790742.472111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135808 00000100:00100000:1.0:1787790742.472121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135808 00000100:00100000:1.0:1787790742.472198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250135936 00000100:00100000:1.0:1787790742.472202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250135936 00000100:00100000:1.0:1787790742.472237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 109 00000100:00100000:1.0:1787790742.472251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250135808:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790742.472352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250135808:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 104us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790742.472361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 109 00000100:00100000:1.0:1787790742.472382:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 110 00000100:00100000:1.0:1787790742.472389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250135936:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790742.472416:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250135936:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 29us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790742.472422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 110 00000100:00080000:0.0:1787790742.473044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790742.473051:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790742.478549:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 285 00000100:00100000:2.0:1787790742.478581:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2402:x1874634250135680:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790742.478684:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2402:x1874634250135680:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 121us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790742.478692:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 285 00010000:00010000:3.0:1787790743.373081:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790743.883033:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790743.883077:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268032384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790743.883266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790743.885045:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032384 00000100:00100000:2.0:1787790743.885073:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032384 00000100:00100000:3.0:1787790743.885510:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787790743.885525:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268032384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790743.885573:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790743.885682:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268032384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790743.885690:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787790743.886010:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a81a40 x1874634268032384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790743.886036:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268032384:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787790743.886099:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790743.886228:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268032512:0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.886280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790743.886320:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268033024:0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.886513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790743.886544:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268033536:0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.886572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790743.886597:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268034048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790743.886622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.886636:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268032896:0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.886641:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787790743.886662:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268032640:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.886667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.886684:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268033408:0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.886687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790743.887084:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033024 00000100:00100000:0.0:1787790743.887098:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033024 00000100:00100000:0.0:1787790743.887141:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032640 00000100:00100000:2.0:1787790743.887144:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268033152:0@lo:400:kworker.0 00000100:00100000:0.0:1787790743.887144:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032640 00000100:00100000:0.0:1787790743.887164:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787790743.887172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790743.887172:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268033024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.887191:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268033664:0@lo:400:kworker.0 00000100:00100000:1.0:1787790743.887319:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032896 00000100:00100000:1.0:1787790743.887323:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032896 00000100:00100000:1.0:1787790743.887357:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787790743.887365:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268032896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.890190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.891260:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268033920:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.891339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.891377:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787790743.891387:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268032768:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.891416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.891446:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268033280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.891473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.891485:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268033792:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.891505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790743.891587:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034048 00000100:00100000:3.0:1787790743.891596:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034048 00000100:00100000:3.0:1787790743.891665:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787790743.891674:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268034048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790743.892834:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790743.892988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790743.893056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033152 00000100:00100000:2.0:1787790743.893073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033152 00000100:00100000:3.0:1787790743.893106:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268034048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1430us (6480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790743.893117:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033280 00000100:00100000:2.0:1787790743.893121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033280 00000100:00100000:2.0:1787790743.893134:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033792 00000100:00100000:2.0:1787790743.893137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033792 00000100:00100000:2.0:1787790743.893149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033664 00000100:00100000:2.0:1787790743.893152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033664 00000100:00100000:2.0:1787790743.893167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787790743.893177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268032640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.893226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268032640:12345-0@lo:400:kworker.0 Request processed in 52us (6538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790743.893233:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787790743.893254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787790743.893260:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268033152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.893291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268033152:12345-0@lo:400:kworker.0 Request processed in 32us (6118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790743.893297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787790743.893309:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787790743.893315:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268033280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790743.893392:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268033024:12345-0@lo:400:kworker.0 Request processed in 6219us (6878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790743.893401:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787790743.893421:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787790743.893429:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.893486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268033280:12345-0@lo:400:kworker.0 Request processed in 169us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790743.893500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787790743.893513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787790743.893518:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268033664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.893550:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268033664:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790743.893555:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787790743.893615:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787790743.893645:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033536 00000100:00100000:3.0:1787790743.893649:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033536 00000100:00100000:3.0:1787790743.893680:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033408 00000100:00100000:3.0:1787790743.893683:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033408 00000100:00100000:3.0:1787790743.893695:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268033920 00000100:00100000:3.0:1787790743.893698:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268033920 00000100:00100000:3.0:1787790743.893738:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790743.893745:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268033536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.893781:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268033536:12345-0@lo:400:kworker.0 Request processed in 37us (7208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790743.893787:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790743.893798:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790743.893804:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268033408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790743.893915:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032768 00000100:00100000:1.0:1787790743.893921:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032768 00000100:00100000:1.0:1787790743.893945:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787790743.893951:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268032768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790743.900658:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268033792:12345-0@lo:400:kworker.0 Request processed in 7211us (9131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790743.900679:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787790743.900808:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787790743.900845:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268033920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790743.901468:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268033920:12345-0@lo:400:kworker.0 Request processed in 648us (10126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790743.901478:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787790743.904665:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268032896:12345-0@lo:400:kworker.0 Request processed in 17284us (17979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790743.904686:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1787790743.906258:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a80780 x1874634268033280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790743.906284:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268033280:0@lo:400:kworker.0 00010000:00080000:2.0:1787790743.906313:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371e1c0 x1874634268033792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790743.906323:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268033792:0@lo:400:kworker.0 00000100:00100000:2.0:1787790743.906338:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268032896:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.908346:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268033408:12345-0@lo:400:kworker.0 Request processed in 14528us (18152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790743.908366:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790743.908433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268032512 00000100:00100000:3.0:1787790743.908444:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268032512 00000100:00100000:3.0:1787790743.908523:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787790743.908534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268032512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.908627:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268032512:12345-0@lo:400:kworker.0 Request processed in 95us (22347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790743.908633:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787790743.909630:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268032640:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.909649:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268033152:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.909684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268033664:0@lo:400:kworker.0 00010000:00080000:3.0:1787790743.909703:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbebc780 x1874634268034048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790743.911172:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268032768:12345-0@lo:400:kworker.0 Request processed in 17210us (19743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790743.911189:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787790743.911978:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268034048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790743.912016:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268032512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.912034:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268033024:0@lo:400:kworker.0 00010000:00080000:3.0:1787790743.912052:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37152c0 x1874634268033536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790743.912071:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268033536:0@lo:400:kworker.0 00000100:00080000:1.0:1787790743.913164:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790743.913175:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790743.913179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790743.913182:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787790743.913388:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a80b40 x1874634268033408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790743.913403:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268033408:0@lo:400:kworker.0 00010000:00080000:3.0:1787790743.913690:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371f0c0 x1874634268033920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790743.913702:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268033920:0@lo:400:kworker.0 00000100:00100000:3.0:1787790743.914567:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268032768:0@lo:400:kworker.0 00000001:02000400:2.0:1787790744.165032:0:11988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:32:23 (1787790743) === 00010000:00010000:2.0:1787790744.399762:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790744.530204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790744.530388:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136064 00000100:00100000:2.0:1787790744.530400:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136064 00000100:00100000:2.0:1787790744.530508:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 287 00000100:00100000:2.0:1787790744.530521:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:8720:x1874634250136064:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790744.530545:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790744.530602:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165ec00/0xcf9477fddcf1dadd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ab0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790744.530643:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165ec00/0xcf9477fddcf1dadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ab0 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790744.530656:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165ec00/0xcf9477fddcf1dadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ab0 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790744.530680:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165ec00, rc 0) 00000100:00100000:2.0:1787790744.530824:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8720:x1874634250136064:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 306us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.530833:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 287 00000100:00100000:0.0:1787790744.540358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.540508:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136192 00000100:00100000:3.0:1787790744.540521:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136192 00000100:00100000:3.0:1787790744.540593:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 288 00000100:00100000:3.0:1787790744.540606:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8720:x1874634250136192:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787790744.540878:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8720:x1874634250136192:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 273us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.540886:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 288 00000100:00100000:1.0:1787790744.543300:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790744.543458:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136320 00000100:00100000:2.0:1787790744.543527:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136320 00000100:00100000:2.0:1787790744.543598:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 289 00000100:00100000:2.0:1787790744.543611:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8720:x1874634250136320:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787790744.543867:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8720:x1874634250136320:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 257us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.543876:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 289 00000100:00100000:1.0:1787790744.550243:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790744.550657:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136448 00000100:00100000:0.0:1787790744.550671:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136448 00000100:00100000:0.0:1787790744.550846:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 290 00000100:00100000:0.0:1787790744.550861:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8724:x1874634250136448:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790744.555810:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8724:x1874634250136448:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 4932us (5563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.555862:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 290 00000100:00100000:0.0:1787790744.606972:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.607410:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136576 00000100:00100000:3.0:1787790744.607425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136576 00000100:00100000:3.0:1787790744.607503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 291 00000100:00100000:3.0:1787790744.607515:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8724:x1874634250136576:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790744.607783:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8724:x1874634250136576:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 269us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.607792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 291 00000100:00100000:1.0:1787790744.615971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790744.616154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136704 00000100:00100000:0.0:1787790744.616169:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136704 00000100:00100000:0.0:1787790744.616253:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 292 00000100:00100000:0.0:1787790744.616266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8724:x1874634250136704:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790744.616496:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8724:x1874634250136704:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 232us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.616507:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 292 00000100:00100000:1.0:1787790744.621232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790744.621357:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136832 00000100:00100000:2.0:1787790744.621373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136832 00000100:00100000:2.0:1787790744.621452:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 293 00000100:00100000:2.0:1787790744.621466:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:8720:x1874634250136832:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790744.621490:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790744.621515:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165fe00/0xcf9477fddcf1dae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ae1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790744.621582:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165fe00/0xcf9477fddcf1dae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae1 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790744.621596:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165fe00/0xcf9477fddcf1dae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae1 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790744.621609:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165fe00, rc 0) 00000100:00100000:2.0:1787790744.621696:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:8720:x1874634250136832:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 232us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.621751:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 293 00000100:00100000:1.0:1787790744.630547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.630773:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250136960 00000100:00100000:3.0:1787790744.630788:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250136960 00000100:00100000:3.0:1787790744.630863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 294 00000100:00100000:3.0:1787790744.630875:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:8720:x1874634250136960:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787790744.630915:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787790744.631077:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787790744.631083:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787790744.631087:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787790744.631090:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787790744.631092:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787790744.636560:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:8720:x1874634250136960:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 5668us (6010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.636580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 294 00000100:00100000:1.0:1787790744.644642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790744.644832:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137088 00000100:00100000:0.0:1787790744.644846:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137088 00000100:00100000:0.0:1787790744.644919:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 295 00000100:00100000:0.0:1787790744.644942:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:8720:x1874634250137088:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787790744.644966:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790744.645222:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ae8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790744.645265:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790744.645280:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790744.645291:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031000, rc 0) 00000100:00100000:0.0:1787790744.645378:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8720:x1874634250137088:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 449us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.646347:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 295 00000100:00100000:1.0:1787790744.651453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.651808:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137216 00000100:00100000:3.0:1787790744.651822:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137216 00000100:00100000:3.0:1787790744.651964:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 296 00000100:00100000:3.0:1787790744.651986:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8720:x1874634250137216:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787790744.652221:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8720:x1874634250137216:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 245us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.652255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 296 00000100:00100000:1.0:1787790744.654326:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790744.654436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137344 00000100:00100000:0.0:1787790744.654450:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137344 00000100:00100000:0.0:1787790744.654520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 297 00000100:00100000:0.0:1787790744.654533:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8720:x1874634250137344:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787790744.654756:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8720:x1874634250137344:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 225us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.654766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 297 00000100:00100000:1.0:1787790744.657435:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.657529:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137472 00000100:00100000:3.0:1787790744.657540:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137472 00000100:00100000:3.0:1787790744.657606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 298 00000100:00100000:3.0:1787790744.657617:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8728:x1874634250137472:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790744.657833:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8728:x1874634250137472:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 217us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.657841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 298 00000100:00100000:1.0:1787790744.662436:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790744.662592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137600 00000100:00100000:2.0:1787790744.662605:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137600 00000100:00100000:2.0:1787790744.662675:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 299 00000100:00100000:2.0:1787790744.662687:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8728:x1874634250137600:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790744.662929:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:8728:x1874634250137600:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 243us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.662938:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 299 00000100:00100000:1.0:1787790744.674833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790744.674888:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790744.674919:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790744.674947:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.675183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137728 00000100:00100000:3.0:1787790744.675206:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137728 00000100:00100000:3.0:1787790744.675264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137984 00000100:00100000:3.0:1787790744.675267:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137984 00000100:00100000:3.0:1787790744.675277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138368 00000100:00100000:3.0:1787790744.675280:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138368 00000100:00100000:3.0:1787790744.675321:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138496 00000100:00100000:3.0:1787790744.675325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138496 00000100:00100000:3.0:1787790744.675350:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:3.0:1787790744.675363:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250138368:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790744.675463:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250138368:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 103us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.675471:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:3.0:1787790744.675491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:3.0:1787790744.675499:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250138496:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790744.675528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250138496:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.675557:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:3.0:1787790744.675571:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790744.675575:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874634250137728:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787790744.675606:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f47024d7-c694-4b5e-82d5-d65d38352c76@192.168.202.22@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:3.0:1787790744.675653:0:6512:0:(genops.c:1385:class_connect()) connect: client f47024d7-c694-4b5e-82d5-d65d38352c76, cookie 0xcf9477fddcf1daf2 00000004:00100000:3.0:1787790744.675688:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787790744.675865:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9170f6792000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790744.675899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2399:x1874634250137728:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 322us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.675907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790744.675922:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787790744.675927:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874634250137984:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787790744.675946:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f47024d7-c694-4b5e-82d5-d65d38352c76@192.168.202.22@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:3.0:1787790744.675971:0:6512:0:(genops.c:1385:class_connect()) connect: client f47024d7-c694-4b5e-82d5-d65d38352c76, cookie 0xcf9477fddcf1daf9 00000100:00080000:1.0:1787790744.678212:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790744.678227:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:3.0:1787790744.679104:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787790744.679641:0:6512:0:(import.c:65:import_set_state_nolock()) ffff916fc31fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790744.679774:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2399:x1874634250137984:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 3842us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.679789:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787790744.686385:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790744.686466:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790744.686558:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138240 00000100:00100000:0.0:1787790744.686571:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138240 00000100:00100000:2.0:1787790744.686614:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250137856 00000100:00100000:2.0:1787790744.686621:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250137856 00000100:00100000:2.0:1787790744.686698:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:0.0:1787790744.686741:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:2.0:1787790744.686748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+7:0:x1874634250137856:12345-192.168.202.22@tcp:41:mount.lustre.0 00000100:00100000:0.0:1787790744.686757:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+7:8720:x1874634250138240:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787790744.686814:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:0.0:1787790744.686814:0:10093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787790744.686939:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+7:8720:x1874634250138240:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 187us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.686948:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00080000:1.0:1787790744.687807:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790744.690785:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+6:0:x1874634250137856:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 4021us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.690808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:1.0:1787790744.695040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790744.695880:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138624 00000100:00100000:2.0:1787790744.695897:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138624 00000100:00100000:2.0:1787790744.696004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:2.0:1787790744.696018:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:8720:x1874634250138624:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787790744.696217:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:8720:x1874634250138624:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 201us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.696227:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:0.0:1787790744.704396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790744.707474:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790744.707517:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.707638:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139008 00000100:00100000:3.0:1787790744.707653:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139008 00000100:00100000:1.0:1787790744.707654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790744.707761:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138112 00000100:00100000:2.0:1787790744.707768:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138112 00000100:00100000:3.0:1787790744.707781:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787790744.707797:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:8720:x1874634250139008:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787790744.707828:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:2.0:1787790744.707838:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+6:0:x1874634250138112:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787790744.707872:0:10094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790744.707978:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+6:0:x1874634250138112:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 141us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790744.707987:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00080000:2.0:1787790744.708020:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790744.708027:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:8720:x1874634250139008:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 231us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.708037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:1.0:1787790744.715676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790744.717039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139136 00000100:00100000:3.0:1787790744.717088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139136 00000100:00100000:3.0:1787790744.717180:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:3.0:1787790744.717193:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:8720:x1874634250139136:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787790744.717462:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787790744.717582:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:8720:x1874634250139136:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 391us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790744.717591:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:0.0:1787790744.718536:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138752 00000100:00100000:0.0:1787790744.718547:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138752 00000100:00100000:0.0:1787790744.718617:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250138880 00000100:00100000:0.0:1787790744.718621:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250138880 00000100:00100000:1.0:1787790744.718642:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:1.0:1787790744.718653:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874634250138752:12345-192.168.202.22@tcp:8:mount.lustre.0 00000100:00100000:0.0:1787790744.718654:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787790744.718665:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1874634250138880:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787790744.718779:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f47024d7-c694-4b5e-82d5-d65d38352c76@192.168.202.22@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:1.0:1787790744.718822:0:8428:0:(genops.c:1385:class_connect()) connect: client f47024d7-c694-4b5e-82d5-d65d38352c76, cookie 0xcf9477fddcf1db00 00002000:00100000:1.0:1787790744.718839:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f47024d7-c694-4b5e-82d5-d65d38352c76/ffff9170ff55a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787790744.718935:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:0.0:1787790744.723004:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f47024d7-c694-4b5e-82d5-d65d38352c76@192.168.202.22@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:0.0:1787790744.723074:0:8427:0:(genops.c:1385:class_connect()) connect: client f47024d7-c694-4b5e-82d5-d65d38352c76, cookie 0xcf9477fddcf1db07 00002000:00100000:0.0:1787790744.723115:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f47024d7-c694-4b5e-82d5-d65d38352c76/ffff916fc1d24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787790744.723130:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787790744.723251:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787790744.723299:0:8427:0:(import.c:65:import_set_state_nolock()) ffff916fc1d22000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790744.723414:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2399:x1874634250138880:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 4748us (15759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790744.723429:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00002000:00080000:1.0:1787790744.724623:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787790744.724692:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170ff55c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790744.725142:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2399:x1874634250138752:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 6483us (17618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790744.725155:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00010000:00010000:1.0:1787790745.423186:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790746.443966:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268034176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790746.444080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790746.444186:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034176 00000100:00100000:0.0:1787790746.444195:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034176 00000100:00100000:0.0:1787790746.444275:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790746.444289:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268034176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790746.444331:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790746.444388:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268034176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790746.444397:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787790746.444423:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790746.444463:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbebc780 x1874634268034176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790746.444485:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268034176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790746.446114:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790746.446139:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268034304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790746.446224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790746.446285:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034304 00000100:00100000:0.0:1787790746.446302:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034304 00000100:00100000:0.0:1787790746.446361:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787790746.446371:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268034304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790746.446395:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790746.446443:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268034304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790746.446451:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787790746.446473:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790746.446503:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e70c0 x1874634268034304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790746.446664:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268034304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787790746.447643:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790747.470816:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268034432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790747.470922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790747.471018:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034432 00000100:00100000:0.0:1787790747.471040:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034432 00000100:00100000:0.0:1787790747.471108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787790747.471119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268034432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790747.471171:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790747.471229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268034432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790747.471236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787790747.471294:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268034432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787790747.471593:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790747.481408:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268034560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790747.481532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790747.481645:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034560 00000100:00100000:2.0:1787790747.481657:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034560 00000100:00100000:0.0:1787790747.481817:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787790747.482177:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268034560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790747.482220:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787790747.483369:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268034560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1533us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790747.483566:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787790747.483595:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268034560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787790748.491036:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790749.002972:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790749.002999:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268034688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790749.003092:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.003272:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034688 00000100:00100000:2.0:1787790749.003281:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034688 00000100:00100000:2.0:1787790749.003353:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790749.003364:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2643c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268034688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790749.003420:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790749.003575:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2643c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268034688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.003582:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787790749.003700:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790749.003758:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371e580 x1874634268034688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790749.003776:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268034688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790749.004244:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268034816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790749.004282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.004317:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268035328:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.004344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.004360:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268035840:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.004382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.004524:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268036352:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.004545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.005638:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787790749.005652:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268034944:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.005725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.005753:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268035456:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.005780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.005800:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268035968:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.005823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.005860:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035840 00000100:00100000:2.0:1787790749.005868:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035840 00000100:00100000:2.0:1787790749.005921:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036352 00000100:00100000:2.0:1787790749.005924:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036352 00000100:00100000:2.0:1787790749.005942:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035968 00000100:00100000:2.0:1787790749.005944:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035968 00000100:00100000:0.0:1787790749.006095:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034816 00000100:00100000:0.0:1787790749.006099:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034816 00000100:00100000:0.0:1787790749.006130:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790749.006139:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874634268034816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790749.006159:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790749.006205:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874634268034816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790749.006212:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790749.006237:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035328 00000100:00100000:0.0:1787790749.006240:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035328 00000100:00100000:0.0:1787790749.006268:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787790749.006275:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268035328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.006313:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268035328:12345-0@lo:400:kworker.0 Request processed in 40us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790749.006320:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787790749.006338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268034944 00000100:00100000:0.0:1787790749.006341:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268034944 00000100:00100000:0.0:1787790749.006367:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787790749.006374:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268034944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.006401:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268034944:12345-0@lo:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790749.006407:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787790749.007139:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787790749.007164:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268035840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.007209:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268035840:12345-0@lo:400:kworker.0 Request processed in 49us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.007215:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787790749.007235:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787790749.007242:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268036352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.007271:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268036352:12345-0@lo:400:kworker.0 Request processed in 30us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.007276:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787790749.007286:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790749.007292:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268035968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.007326:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268035968:12345-0@lo:400:kworker.0 Request processed in 35us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.007332:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790749.007351:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035456 00000100:00100000:2.0:1787790749.007356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035456 00000100:00100000:2.0:1787790749.007400:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787790749.007408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268035456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.007614:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268034944:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.007630:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268035456:0@lo:400:kworker.0 00010000:00080000:0.0:1787790749.007654:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb61c0 x1874634268035968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790749.007665:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268035968:0@lo:400:kworker.0 00010000:00080000:0.0:1787790749.007676:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e61c0 x1874634268034816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790749.007691:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268034816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790749.007717:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268035328:0@lo:400:kworker.0 00010000:00080000:0.0:1787790749.007729:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb7480 x1874634268035840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790749.007736:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268035840:0@lo:400:kworker.0 00010000:00080000:0.0:1787790749.007744:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373d2c0 x1874634268036352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790749.007751:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268036352:0@lo:400:kworker.0 00000100:00080000:3.0:1787790749.007889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790749.007895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790749.007909:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268035072:0@lo:400:kworker.0 00000100:00100000:1.0:1787790749.008289:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268035200:0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.009036:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790749.009074:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268035584:0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.009101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790749.009122:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268036096:0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.009159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790749.009215:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035072 00000100:00100000:3.0:1787790749.009222:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035072 00000100:00100000:3.0:1787790749.009259:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035584 00000100:00100000:3.0:1787790749.009262:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035584 00000100:00100000:3.0:1787790749.009283:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036096 00000100:00100000:3.0:1787790749.009285:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036096 00000100:00100000:3.0:1787790749.009301:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790749.009309:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268035072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.009355:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268035072:12345-0@lo:400:kworker.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790749.009361:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790749.009377:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787790749.009383:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268035584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.011642:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268035584:12345-0@lo:400:kworker.0 Request processed in 2252us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790749.011656:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787790749.011693:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787790749.011721:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268036096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.011756:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268036096:12345-0@lo:400:kworker.0 Request processed in 57us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790749.011762:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787790749.011810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790749.011863:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268035072:0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.011877:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268035584:0@lo:400:kworker.0 00000100:00100000:3.0:1787790749.011888:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268036096:0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.014174:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268035456:12345-0@lo:400:kworker.0 Request processed in 6757us (8383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.014246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787790749.015073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790749.015160:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268035712:0@lo:400:kworker.0 00000100:00100000:1.0:1787790749.015264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790749.015291:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268036224:0@lo:400:kworker.0 00000100:00100000:1.0:1787790749.015337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790749.016396:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035712 00000100:00100000:2.0:1787790749.016408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035712 00000100:00100000:2.0:1787790749.016537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036224 00000100:00100000:2.0:1787790749.016540:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036224 00000100:00100000:2.0:1787790749.016582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790749.016591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268035712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.016674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268035712:12345-0@lo:400:kworker.0 Request processed in 84us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.016680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790749.016696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787790749.016702:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268036224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790749.016763:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268036224:12345-0@lo:400:kworker.0 Request processed in 61us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790749.016769:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787790749.017555:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787790749.017607:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb6940 x1874634268035712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790749.017622:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268035712:0@lo:400:kworker.0 00010000:00080000:1.0:1787790749.017633:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f480 x1874634268036224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790749.017641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268036224:0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.020083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268035200 00000100:00100000:0.0:1787790749.020102:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268035200 00000100:00100000:0.0:1787790749.020172:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787790749.020183:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268035200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790749.021732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268035200:12345-0@lo:400:kworker.0 Request processed in 1549us (6658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790749.021744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787790749.022051:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268035200:0@lo:400:kworker.0 00010000:00010000:3.0:1787790749.515122:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787790750.030094:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00100000:3.0:1787790750.030198:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00100000:0.0:1787790750.030252:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00100000:2.0:1787790750.030818:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000100:00100000:3.0:1787790750.152157:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152190:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152207:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152225:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152239:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152286:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790750.152316:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139520 00000100:00100000:3.0:1787790750.152325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139520 00000100:00100000:3.0:1787790750.152375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139776 00000100:00100000:3.0:1787790750.152376:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139776 00000100:00100000:3.0:1787790750.152385:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139392 00000100:00100000:3.0:1787790750.152386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139392 00000100:00100000:3.0:1787790750.152393:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139648 00000100:00100000:3.0:1787790750.152394:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139648 00000100:00100000:3.0:1787790750.152404:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:3.0:1787790750.152411:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250139520:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790750.152468:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250139520:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790750.152472:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:3.0:1787790750.152483:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:3.0:1787790750.152487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250139776:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790750.152500:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250139776:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 13us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790750.152504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:3.0:1787790750.152519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:3.0:1787790750.152522:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250139392:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790750.152538:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250139392:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 16us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790750.152542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:3.0:1787790750.152548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:3.0:1787790750.152551:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250139648:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790750.152562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250139648:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 11us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790750.152566:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:3.0:1787790750.152578:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140032 00000100:00100000:3.0:1787790750.152581:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140032 00000100:00100000:3.0:1787790750.152605:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139904 00000100:00100000:3.0:1787790750.152608:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139904 00000100:00100000:3.0:1787790750.152630:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:3.0:1787790750.152636:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250140032:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790750.152654:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250140032:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 20us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790750.152658:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:3.0:1787790750.152665:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:3.0:1787790750.152669:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250139904:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790750.152681:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250139904:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 13us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790750.152685:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00080000:3.0:1787790750.152738:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790750.152742:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790750.152745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790750.152747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790750.153264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250139264 00000100:00100000:0.0:1787790750.153277:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250139264 00000100:00100000:0.0:1787790750.153318:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 301 00000100:00100000:0.0:1787790750.153327:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250139264:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790750.153369:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250139264:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 44us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790750.153377:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 301 00000001:02000400:0.0:1787790750.206129:0:12181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787790750.539818:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790751.564901:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268036480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790751.565008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790751.565107:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036480 00000100:00100000:0.0:1787790751.565123:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036480 00000100:00100000:0.0:1787790751.565179:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790751.565187:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268036480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790751.565218:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790751.565263:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268036480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790751.565270:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787790751.565389:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373c780 x1874634268036480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790751.565407:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268036480:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787790751.568923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787790751.570738:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790751.571153:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790751.571177:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268036608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790751.571255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790751.571315:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036608 00000100:00100000:1.0:1787790751.571322:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036608 00000100:00100000:1.0:1787790751.571376:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787790751.571385:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268036608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790751.571407:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790751.571447:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268036608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790751.571455:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787790751.571495:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d4000 x1874634268036608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790751.571513:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268036608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787790751.572238:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790752.587131:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268036736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790752.587211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790752.587262:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268036864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790752.587290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790752.587330:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036736 00000100:00100000:1.0:1787790752.587337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036736 00000100:00100000:1.0:1787790752.587373:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036864 00000100:00100000:1.0:1787790752.587376:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036864 00000100:00100000:1.0:1787790752.587392:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787790752.587400:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268036736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790752.587433:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790752.587478:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268036736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790752.587485:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787790752.587501:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787790752.587507:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c7f66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268036864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790752.587523:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790752.587549:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c7f66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268036864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790752.587555:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787790752.587856:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268036736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790752.587869:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268036864:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787790752.588311:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790753.611050:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790754.123452:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790754.123479:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268036992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790754.123552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790754.123849:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268037504:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.123882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.123945:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268037120:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.124001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790754.124065:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268036992 00000100:00100000:2.0:1787790754.124072:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268036992 00000100:00100000:2.0:1787790754.124137:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787790754.124147:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268036992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790754.124175:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790754.124217:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268036992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790754.124224:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787790754.125560:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790754.125601:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037504 00000100:00100000:3.0:1787790754.125619:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037504 00000100:00100000:3.0:1787790754.125674:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787790754.125684:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.125763:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268037504:12345-0@lo:400:kworker.0 Request processed in 81us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790754.125770:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787790754.125811:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268037376:0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.125843:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790754.125915:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037376 00000100:00100000:2.0:1787790754.125920:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037376 00000100:00100000:2.0:1787790754.125946:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787790754.125953:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268037376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.126000:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268037376:12345-0@lo:400:kworker.0 Request processed in 46us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790754.126006:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787790754.126285:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268037248:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.126317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.126367:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268037632:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.126395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.126416:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268038144:0@lo:400:kworker.0 00000100:00100000:1.0:1787790754.126440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787790754.126472:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc371fc00 x1874634268036992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790754.126494:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268036992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790754.126511:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268038656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790754.126528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790754.126560:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038656 00000100:00100000:1.0:1787790754.126563:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038656 00000100:00100000:1.0:1787790754.126588:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787790754.126592:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268038656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790754.126651:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790754.126687:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268038656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790754.126694:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787790754.126742:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc2640780 x1874634268038656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790754.126755:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268038656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790754.126926:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268037504:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.126935:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268038016:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.126983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790754.127012:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268038528:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.127036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790754.127073:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037120 00000100:00100000:0.0:1787790754.127078:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037120 00000100:00100000:0.0:1787790754.127107:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787790754.127126:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268037120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.127165:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268037120:12345-0@lo:400:kworker.0 Request processed in 40us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790754.127171:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787790754.127200:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038144 00000100:00100000:0.0:1787790754.127203:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038144 00000100:00100000:0.0:1787790754.127231:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038016 00000100:00100000:0.0:1787790754.127234:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038016 00000100:00100000:0.0:1787790754.127246:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038528 00000100:00100000:0.0:1787790754.127249:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038528 00000100:00100000:0.0:1787790754.127260:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790754.127265:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268038144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.127301:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268038144:12345-0@lo:400:kworker.0 Request processed in 36us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790754.127307:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790754.127319:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790754.127325:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268038016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.127355:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268038016:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790754.127361:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787790754.127372:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787790754.127385:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.127412:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268038528:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790754.127418:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787790754.127450:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f480 x1874634268038016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790754.127461:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268038016:0@lo:400:kworker.0 00010000:00080000:0.0:1787790754.127471:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb7c00 x1874634268038528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790754.127479:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268038528:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.127505:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268037120:0@lo:400:kworker.0 00010000:00080000:0.0:1787790754.127515:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f0c0 x1874634268038144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790754.127523:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268038144:0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.127924:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268037376:0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.127934:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268037888:0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.127976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790754.128007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268038400:0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.128029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790754.128065:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037248 00000100:00100000:3.0:1787790754.128070:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037248 00000100:00100000:3.0:1787790754.128100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037632 00000100:00100000:3.0:1787790754.128103:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037632 00000100:00100000:3.0:1787790754.128124:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037888 00000100:00100000:3.0:1787790754.128133:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037888 00000100:00100000:3.0:1787790754.128150:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038400 00000100:00100000:3.0:1787790754.128151:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038400 00000100:00100000:3.0:1787790754.128163:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787790754.128169:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268037248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.128203:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268037248:12345-0@lo:400:kworker.0 Request processed in 34us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790754.128209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787790754.128220:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787790754.128226:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268037632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.128257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268037632:12345-0@lo:400:kworker.0 Request processed in 32us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790754.128263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787790754.128273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790754.128278:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268037888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.128306:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268037888:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790754.128312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790754.128323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787790754.128328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268038400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790754.128354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268038400:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790754.128359:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787790754.128385:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790754.128390:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790754.128392:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790754.128415:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268037632:0@lo:400:kworker.0 00010000:00080000:3.0:1787790754.128442:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373d2c0 x1874634268037888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790754.128450:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268037888:0@lo:400:kworker.0 00010000:00080000:3.0:1787790754.128457:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb7840 x1874634268038400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790754.128466:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268038400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.129281:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268037248:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.129290:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268037760:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.129327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790754.129356:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268038272:0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.129379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790754.129534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268037760 00000100:00100000:0.0:1787790754.129541:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268037760 00000100:00100000:0.0:1787790754.129594:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038272 00000100:00100000:0.0:1787790754.129597:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038272 00000100:00100000:2.0:1787790754.129691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787790754.129701:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268037760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790754.129760:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268037760:12345-0@lo:400:kworker.0 Request processed in 61us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790754.129766:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787790754.129802:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268037760:0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.129921:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787790754.129928:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268038272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790754.129962:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268038272:12345-0@lo:400:kworker.0 Request processed in 36us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790754.129980:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787790754.130003:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268038272:0@lo:400:kworker.0 00000100:00080000:1.0:1787790754.130081:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790754.641848:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790755.272609:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790755.272659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790755.272752:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140160 00000100:00100000:3.0:1787790755.272763:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140160 00000100:00100000:3.0:1787790755.272826:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 303 00000100:00100000:3.0:1787790755.272835:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250140160:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790755.272914:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250140160:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790755.272920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 303 00000100:00100000:0.0:1787790755.273572:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140288 00000100:00100000:0.0:1787790755.273588:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140288 00000100:00100000:0.0:1787790755.273839:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:0.0:1787790755.273852:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250140288:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790755.273948:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250140288:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 99us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790755.273968:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00080000:3.0:1787790755.294639:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790755.297779:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790755.298384:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140416 00000100:00100000:3.0:1787790755.298410:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140416 00000100:00100000:3.0:1787790755.298480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:3.0:1787790755.298489:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250140416:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790755.298574:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250140416:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 86us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790755.298581:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00080000:3.0:1787790755.299536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790755.299626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790755.299732:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790755.300630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790755.300674:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790755.300764:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140800 00000100:00100000:2.0:1787790755.300778:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140800 00000100:00100000:2.0:1787790755.300868:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140928 00000100:00100000:2.0:1787790755.300871:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140928 00000100:00100000:2.0:1787790755.300901:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:2.0:1787790755.300914:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250140800:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790755.301032:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250140800:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 120us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790755.301921:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:1.0:1787790755.301944:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250140928:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790755.302043:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250140928:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 110us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790755.302051:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:2.0:1787790755.303309:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:3.0:1787790755.306375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140544 00000100:00100000:3.0:1787790755.306398:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140544 00000100:00100000:3.0:1787790755.306511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250140672 00000100:00100000:3.0:1787790755.306515:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250140672 00000100:00100000:3.0:1787790755.306560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:3.0:1787790755.306573:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250140544:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790755.306682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250140544:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 111us (7061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790755.306690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:3.0:1787790755.306729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:3.0:1787790755.306737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250140672:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790755.306771:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250140672:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 35us (7038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790755.306777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00080000:2.0:1787790755.307822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790755.307833:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790755.307839:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790755.307844:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790755.658856:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790756.683056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790756.683116:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268038784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790756.683219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790756.683984:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790756.684433:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038784 00000100:00100000:1.0:1787790756.684445:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038784 00000100:00100000:1.0:1787790756.684529:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787790756.684544:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268038784:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787790756.684555:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790756.684567:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:1.0:1787790756.684588:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790756.684653:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268038912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790756.684779:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268038784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 238us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790756.684789:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787790756.684816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790756.687388:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268038912 00000100:00100000:0.0:1787790756.687411:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268038912 00010000:00080000:3.0:1787790756.687479:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb5e00 x1874634268038784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790756.687514:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268038784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790756.687524:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787790756.687538:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268038912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790756.687570:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790756.687690:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268038912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790756.687699:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787790756.687802:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790756.690836:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb7480 x1874634268038912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790756.690869:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268038912:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1787790757.271222:0:12497:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790757.271535:0:12497:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787790757.706969:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790757.708749:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268039040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790757.708847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790757.709020:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268039168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790757.709048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790757.709231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039040 00000100:00100000:1.0:1787790757.709242:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039040 00000100:00100000:1.0:1787790757.709304:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039168 00000100:00100000:1.0:1787790757.709307:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039168 00000100:00100000:1.0:1787790757.709325:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787790757.709336:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268039040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790757.709388:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787790757.709390:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790757.709415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268039168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790757.709438:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790757.709454:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268039040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790757.709464:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787790757.709475:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268039168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790757.709481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790757.709524:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268039168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790757.709625:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268039040:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787790758.730987:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790759.243283:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268039296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790759.243389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.243498:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039296 00000100:00100000:3.0:1787790759.243508:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039296 00000100:00100000:3.0:1787790759.243597:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787790759.243611:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268039296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790759.243649:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790759.243731:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268039296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.243741:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787790759.243778:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790759.243813:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f44f00 x1874634268039296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790759.243835:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268039296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790759.246216:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268039424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790759.246308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.246389:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039424 00000100:00100000:3.0:1787790759.246398:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039424 00000100:00100000:3.0:1787790759.246468:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787790759.246493:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268039424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790759.246523:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790759.246650:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268039424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.246658:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787790759.246684:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787790759.246741:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd2d00 x1874634268039424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790759.247161:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268039424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790759.254018:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268039680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.254248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.254314:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790759.254322:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268039552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.254357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.254401:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039680 00000100:00100000:3.0:1787790759.254410:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039680 00000100:00100000:3.0:1787790759.254470:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787790759.254482:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268039680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.254544:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268039680:12345-0@lo:400:kworker.0 Request processed in 64us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.254552:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787790759.254595:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039552 00000100:00100000:3.0:1787790759.254599:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039552 00000100:00100000:3.0:1787790759.254627:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787790759.254633:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268039552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.254663:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268039552:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.254679:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787790759.256680:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268039552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.256744:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268039680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.256792:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790759.256805:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268040064:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.256879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.257043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040064 00000100:00100000:3.0:1787790759.257051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040064 00000100:00100000:3.0:1787790759.257186:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787790759.257196:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268040064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257253:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268040064:12345-0@lo:400:kworker.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.257260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787790759.257295:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268039936:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.257348:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790759.257354:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268039808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.257399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039936 00000100:00100000:3.0:1787790759.257402:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039936 00000100:00100000:3.0:1787790759.257427:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268039808 00000100:00100000:3.0:1787790759.257429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268039808 00000100:00100000:3.0:1787790759.257442:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787790759.257447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268039936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268039936:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.257500:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787790759.257513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787790759.257519:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268039808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268039808:12345-0@lo:400:kworker.0 Request processed in 28us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.257553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787790759.257593:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268039808:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257603:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268039936:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.257635:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268040064:0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.258396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268040448:0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.258452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790759.258487:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787790759.258493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268040320:0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.258518:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790759.258538:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268040832:0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.258572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790759.258623:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040448 00000100:00100000:2.0:1787790759.258629:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040448 00000100:00100000:2.0:1787790759.258689:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790759.258698:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268040448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.258796:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268040448:12345-0@lo:400:kworker.0 Request processed in 99us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790759.258802:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787790759.258826:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040320 00000100:00100000:2.0:1787790759.258830:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040320 00000100:00100000:2.0:1787790759.258858:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040832 00000100:00100000:2.0:1787790759.258861:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040832 00000100:00100000:2.0:1787790759.258883:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787790759.258890:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268040320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.258946:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268040320:12345-0@lo:400:kworker.0 Request processed in 55us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790759.258956:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787790759.258967:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787790759.258973:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268040832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790759.259001:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268040832:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790759.259008:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1787790759.259033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790759.259049:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790759.259296:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a06580 x1874634268040320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790759.259310:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268040320:0@lo:400:kworker.0 00010000:00080000:2.0:1787790759.259324:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a06d00 x1874634268040832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790759.259344:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268040832:0@lo:400:kworker.0 00010000:00080000:2.0:1787790759.259357:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a06940 x1874634268040448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790759.259365:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268040448:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.259662:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268040192:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.259757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.260617:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268040704:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.260663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.260694:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790759.260702:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268040576:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.260759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790759.260812:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040192 00000100:00100000:3.0:1787790759.260819:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040192 00000100:00100000:3.0:1787790759.260891:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040704 00000100:00100000:3.0:1787790759.261204:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040704 00000100:00100000:3.0:1787790759.261240:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787790759.261251:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268040192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.261315:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268040192:12345-0@lo:400:kworker.0 Request processed in 66us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.261340:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787790759.261358:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787790759.261364:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268040704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.261393:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268040704:12345-0@lo:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.261399:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787790759.261560:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268040192:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.261585:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268040704:0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.262791:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040576 00000100:00100000:3.0:1787790759.262803:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040576 00000100:00100000:3.0:1787790759.262867:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787790759.262877:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268040576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790759.262974:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268040576:12345-0@lo:400:kworker.0 Request processed in 99us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790759.262981:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787790759.263007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790759.263013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787790759.263286:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a07480 x1874634268040576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790759.263300:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268040576:0@lo:400:kworker.0 00000020:00000004:1.0:1787790759.307181:0:12594:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790759.307535:0:12594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787790759.755038:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790760.395832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790760.395879:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790760.395907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790760.396058:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141184 00000100:00100000:0.0:1787790760.396070:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141184 00000100:00100000:0.0:1787790760.396148:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141440 00000100:00100000:0.0:1787790760.396151:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141440 00000100:00100000:0.0:1787790760.396178:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 145 00000100:00100000:0.0:1787790760.396190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250141184:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790760.396302:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250141184:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 114us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790760.396311:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 145 00000100:00100000:0.0:1787790760.396330:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00100000:0.0:1787790760.396347:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141440:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790760.396376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141440:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790760.396382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00100000:3.0:1787790760.398558:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790760.398625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790760.398650:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790760.398677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790760.398732:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141312 00000100:00100000:3.0:1787790760.398743:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141312 00000100:00100000:3.0:1787790760.398797:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141568 00000100:00100000:3.0:1787790760.398800:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141568 00000100:00100000:3.0:1787790760.398819:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:3.0:1787790760.398829:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250141312:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790760.398924:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250141312:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.398933:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:3.0:1787790760.398952:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:3.0:1787790760.398959:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141568:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790760.398987:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141568:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.398993:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00080000:3.0:1787790760.399013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790760.399017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790760.399205:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141696 00000100:00100000:1.0:1787790760.399211:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141696 00000100:00100000:3.0:1787790760.399261:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141056 00000100:00100000:3.0:1787790760.399267:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141056 00000100:00100000:3.0:1787790760.399300:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 305 00000100:00100000:3.0:1787790760.399307:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250141056:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790760.399341:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250141056:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 35us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.399348:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 305 00000100:00100000:3.0:1787790760.399397:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141824 00000100:00100000:3.0:1787790760.399401:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141824 00000100:00100000:1.0:1787790760.405216:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:1.0:1787790760.405240:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141696:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790760.405374:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141696:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 143us (9465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790760.405384:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:3.0:1787790760.406084:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:3.0:1787790760.406095:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141824:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790760.406149:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250141824:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 56us (7470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790760.406157:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00080000:2.0:1787790760.409310:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790760.409322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787790760.783500:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787790761.486544:0:12691:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790761.487144:0:12691:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787790761.803050:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268040960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790761.803167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790761.803274:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268040960 00000100:00100000:3.0:1787790761.803285:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268040960 00000100:00100000:3.0:1787790761.803357:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787790761.803371:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268040960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787790761.803411:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790761.803470:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268040960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790761.803478:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787790761.803504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790761.803540:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a81680 x1874634268040960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790761.803563:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268040960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790761.804845:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268041088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790761.804933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790761.805119:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041088 00000100:00100000:0.0:1787790761.805129:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041088 00000100:00100000:0.0:1787790761.805207:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787790761.805217:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268041088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790761.805244:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790761.805296:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268041088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790761.805304:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1787790761.806974:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787790761.807284:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb6d00 x1874634268041088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790761.807315:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268041088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790761.808169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790762.827035:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787790762.827977:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790762.828224:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268041344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790762.828348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790762.828511:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041344 00000100:00100000:1.0:1787790762.828522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041344 00000100:00100000:1.0:1787790762.828599:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787790762.828613:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268041344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790762.828663:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790762.828749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268041344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790762.828757:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787790762.828867:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268041344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790762.829067:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268041216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790762.829113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790762.830954:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041216 00000100:00100000:3.0:1787790762.830972:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041216 00000100:00100000:3.0:1787790762.831044:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787790762.831057:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268041216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790762.831108:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787790762.831225:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268041216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790762.831233:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787790762.831300:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268041216:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1787790763.510548:0:12789:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790763.511267:0:12789:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787790763.851390:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790764.366043:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268041472:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366166:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268041984:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366193:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366212:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268042496:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366253:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268043008:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366271:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366291:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787790764.366296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268041856:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366335:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268042368:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366394:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268042880:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366443:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268041600:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366484:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268042112:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366518:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268042624:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366554:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787790764.366559:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268041728:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366594:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268042240:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366635:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268042752:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790764.366680:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041472 00000100:00100000:3.0:1787790764.366686:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041472 00000100:00100000:3.0:1787790764.366759:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787790764.366768:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268041472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.366813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268041472:12345-0@lo:400:kworker.0 Request processed in 46us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.366820:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787790764.366851:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041984 00000100:00100000:3.0:1787790764.366855:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041984 00000100:00100000:3.0:1787790764.366895:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041600 00000100:00100000:3.0:1787790764.366898:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041600 00000100:00100000:3.0:1787790764.366909:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042112 00000100:00100000:3.0:1787790764.366911:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042112 00000100:00100000:3.0:1787790764.366931:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042624 00000100:00100000:3.0:1787790764.366934:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042624 00000100:00100000:3.0:1787790764.366946:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042240 00000100:00100000:3.0:1787790764.366948:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042240 00000100:00100000:3.0:1787790764.366959:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042752 00000100:00100000:3.0:1787790764.366962:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042752 00000100:00100000:3.0:1787790764.366974:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787790764.366979:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268041984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367006:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268041984:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367011:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787790764.367020:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787790764.367025:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268041600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367052:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268041600:12345-0@lo:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367057:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787790764.367066:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787790764.367071:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268042112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367091:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268042112:12345-0@lo:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367095:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787790764.367103:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787790764.367108:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268042624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367129:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268042624:12345-0@lo:400:kworker.0 Request processed in 21us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367140:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787790764.367149:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787790764.367154:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268042240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367178:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268042240:12345-0@lo:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367183:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787790764.367192:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787790764.367197:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268042752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367219:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268042752:12345-0@lo:400:kworker.0 Request processed in 22us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367224:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787790764.367241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041856 00000100:00100000:3.0:1787790764.367244:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041856 00000100:00100000:3.0:1787790764.367264:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268041728 00000100:00100000:3.0:1787790764.367267:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268041728 00000100:00100000:3.0:1787790764.367279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787790764.367285:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268041856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367315:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268041856:12345-0@lo:400:kworker.0 Request processed in 30us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367321:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787790764.367331:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787790764.367336:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268041728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268041728:12345-0@lo:400:kworker.0 Request processed in 25us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367365:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787790764.367388:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042496 00000100:00100000:3.0:1787790764.367391:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042496 00000100:00100000:3.0:1787790764.367407:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043008 00000100:00100000:3.0:1787790764.367409:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043008 00000100:00100000:3.0:1787790764.367420:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042368 00000100:00100000:3.0:1787790764.367422:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042368 00000100:00100000:3.0:1787790764.367432:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268042880 00000100:00100000:3.0:1787790764.367435:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268042880 00000100:00100000:3.0:1787790764.367448:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790764.367454:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268042496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367488:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268042496:12345-0@lo:400:kworker.0 Request processed in 34us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367493:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787790764.367504:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787790764.367509:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268043008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367533:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268043008:12345-0@lo:400:kworker.0 Request processed in 25us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367539:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787790764.367548:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787790764.367553:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268042368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367576:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268042368:12345-0@lo:400:kworker.0 Request processed in 23us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367580:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787790764.367589:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787790764.367594:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268042880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367618:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268042880:12345-0@lo:400:kworker.0 Request processed in 23us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790764.367632:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787790764.367688:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268041728:0@lo:400:kworker.0 00010000:00080000:3.0:1787790764.367701:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a570c0 x1874634268042240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790764.367733:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268042240:0@lo:400:kworker.0 00010000:00080000:3.0:1787790764.367744:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a552c0 x1874634268042752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790764.367752:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268042752:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367761:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268041600:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367768:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268042112:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367776:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268042624:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367814:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268041856:0@lo:400:kworker.0 00010000:00080000:3.0:1787790764.367824:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a56580 x1874634268042368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790764.367833:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268042368:0@lo:400:kworker.0 00010000:00080000:3.0:1787790764.367842:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a56d00 x1874634268042880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790764.367849:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268042880:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367857:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268041472:0@lo:400:kworker.0 00000100:00100000:3.0:1787790764.367868:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268041984:0@lo:400:kworker.0 00010000:00080000:3.0:1787790764.367906:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a56940 x1874634268042496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790764.367913:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268042496:0@lo:400:kworker.0 00010000:00080000:3.0:1787790764.367922:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a54f00 x1874634268043008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790764.367929:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268043008:0@lo:400:kworker.0 00000100:00100000:1.0:1787790764.368082:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790764.368094:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268043136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790764.368132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790764.368166:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043136 00000100:00100000:1.0:1787790764.368170:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043136 00000100:00100000:1.0:1787790764.368199:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787790764.368206:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f54be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268043136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790764.368227:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790764.368263:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f54be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268043136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790764.368269:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787790764.368459:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d6580 x1874634268043136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790764.368486:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268043136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790764.368628:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268043264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790764.368652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790764.368734:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043264 00000100:00100000:0.0:1787790764.368738:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043264 00000100:00100000:0.0:1787790764.368765:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790764.368771:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268043264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790764.368782:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790764.368818:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268043264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790764.368831:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787790764.368857:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1fb6d00 x1874634268043264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790764.368868:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268043264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787790764.369871:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790764.369889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790764.369893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790764.369896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790764.875965:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790765.510999:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790765.511068:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790765.511214:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250141952 00000100:00100000:0.0:1787790765.511228:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250141952 00000100:00100000:0.0:1787790765.511314:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 307 00000100:00100000:0.0:1787790765.511327:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250141952:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790765.511416:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250141952:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 92us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.511423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 307 00000100:00100000:1.0:1787790765.511564:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142080 00000100:00100000:1.0:1787790765.511572:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142080 00000100:00100000:1.0:1787790765.511638:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 155 00000100:00100000:1.0:1787790765.511646:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250142080:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790765.511682:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250142080:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 38us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.511688:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 155 00000100:00080000:2.0:1787790765.511729:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790765.517510:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790765.517645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790765.517702:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790765.517794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142336 00000100:00100000:1.0:1787790765.517803:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142336 00000100:00100000:1.0:1787790765.517861:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142208 00000100:00100000:1.0:1787790765.517874:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142208 00000100:00100000:1.0:1787790765.517900:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 156 00000100:00100000:1.0:1787790765.517910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250142336:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790765.517982:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250142336:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 74us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.517989:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 156 00000100:00100000:1.0:1787790765.518005:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 157 00000100:00100000:1.0:1787790765.518011:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250142208:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790765.518032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250142208:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 22us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.518039:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 157 00000100:00080000:1.0:1787790765.518068:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790765.518073:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790765.518976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790765.519006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790765.519033:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142592 00000100:00100000:0.0:1787790765.519038:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142592 00000100:00100000:0.0:1787790765.519077:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142720 00000100:00100000:0.0:1787790765.519080:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142720 00000100:00100000:0.0:1787790765.519102:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:0.0:1787790765.519111:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2399:x1874634250142592:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:0.0:1787790765.519135:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1db00 00000100:00080000:0.0:1787790765.519146:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170ff55c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787790765.519210:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787790765.519310:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:1.0:1787790765.519319:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2399:x1874634250142720:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:1.0:1787790765.519331:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1db07 00000100:00080000:1.0:1787790765.519337:0:8427:0:(import.c:65:import_set_state_nolock()) ffff916fc1d22000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790765.519368:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787790765.519581:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+2:2399:x1874634250142720:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 263us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.519589:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00010000:00010000:1.0:1787790765.519618:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790765.519628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142464 00000100:00100000:1.0:1787790765.519632:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142464 00000100:00100000:1.0:1787790765.519659:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 158 00000100:00100000:1.0:1787790765.519665:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250142464:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790765.519692:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250142464:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 27us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790765.519698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 158 00000100:00080000:1.0:1787790765.519740:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790765.519744:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790765.519746:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790765.519992:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+2:2399:x1874634250142592:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 881us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790765.519998:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00010000:00010000:0.0:1787790765.520014:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787790765.525642:0:12886:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790765.529476:0:12886:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787790765.899681:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790766.923147:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268043392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790766.923233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790766.923371:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043392 00000100:00100000:3.0:1787790766.923380:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043392 00000100:00100000:3.0:1787790766.923445:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790766.923457:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268043392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787790766.923488:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790766.923533:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268043392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790766.923539:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:3.0:1787790766.924351:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787790766.924404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790766.924440:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3765a40 x1874634268043392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790766.924460:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268043392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790766.924477:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790766.924483:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268043520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790766.924519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790766.924739:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043520 00000100:00100000:3.0:1787790766.924745:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043520 00000100:00100000:3.0:1787790766.924790:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787790766.924798:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268043520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790766.924814:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790766.924848:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268043520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790766.924864:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787790766.925932:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790766.925973:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a043c0 x1874634268043520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790766.925991:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268043520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790767.947059:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268043648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790767.947142:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790767.947331:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043648 00000100:00100000:3.0:1787790767.947338:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043648 00000100:00100000:3.0:1787790767.947408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790767.947419:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268043648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787790767.947459:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787790767.947520:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268043648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790767.947528:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787790767.947630:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268043648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787790767.947740:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790767.951592:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268043776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790767.951671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790767.951860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043776 00000100:00100000:1.0:1787790767.951869:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043776 00000100:00100000:1.0:1787790767.951922:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787790767.951930:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268043776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790767.951976:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790767.952333:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268043776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 402us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790767.952359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790767.952737:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268043776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787790768.971852:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790769.176627:0:13030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787790769.485342:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790769.485375:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268043904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790769.485466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.485670:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790769.485678:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268044032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790769.485698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.485740:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268043904 00000100:00100000:3.0:1787790769.485748:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268043904 00000100:00100000:3.0:1787790769.485809:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044032 00000100:00100000:3.0:1787790769.485813:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044032 00000100:00100000:3.0:1787790769.485845:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787790769.485857:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268043904:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790769.485900:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00002000:00000024:3.0:1787790769.485903:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790769.485910:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268044032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790769.485922:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790769.485950:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268043904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790769.485955:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268044032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.485959:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787790769.485962:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787790769.485985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787790769.486014:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37661c0 x1874634268044032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790769.486036:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268044032:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787790769.486049:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d52c0 x1874634268043904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790769.486061:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268043904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790769.486255:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790769.486310:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790769.486321:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268044288:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.486355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790769.486440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044288 00000100:00100000:1.0:1787790769.486444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044288 00000100:00100000:1.0:1787790769.486487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787790769.486495:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268044288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790769.486536:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268044288:12345-0@lo:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790769.486543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787790769.486574:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268044288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.486662:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268044160:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.486700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790769.487073:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268044416:0@lo:400:kworker.0 00000100:00100000:1.0:1787790769.487106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.487254:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044160 00000100:00100000:3.0:1787790769.487278:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044160 00000100:00100000:3.0:1787790769.487315:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787790769.487323:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268044160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.487361:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268044160:12345-0@lo:400:kworker.0 Request processed in 40us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.487368:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787790769.487411:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268044160:0@lo:400:kworker.0 00000100:00100000:2.0:1787790769.487476:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044416 00000100:00100000:2.0:1787790769.487481:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044416 00000100:00100000:2.0:1787790769.487519:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787790769.487527:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268044416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.487649:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268044544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.487682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790769.487769:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790769.487774:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268044928:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.487799:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790769.487851:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268045056:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.487877:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790769.487947:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790769.487955:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268045440:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.487981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790769.488031:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044928 00000100:00100000:0.0:1787790769.488035:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044928 00000100:00100000:0.0:1787790769.488072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045440 00000100:00100000:0.0:1787790769.488075:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045440 00000100:00100000:0.0:1787790769.488095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787790769.488102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268044928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044544 00000100:00100000:3.0:1787790769.488236:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044544 00000100:00100000:3.0:1787790769.488262:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787790769.488269:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268044544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.488352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268044928:12345-0@lo:400:kworker.0 Request processed in 251us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790769.488360:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787790769.488376:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787790769.488382:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268045440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790769.488449:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268044416:12345-0@lo:400:kworker.0 Request processed in 922us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790769.488456:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787790769.488513:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268044544:12345-0@lo:400:kworker.0 Request processed in 244us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.488520:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1787790769.488545:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790769.488555:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268044800:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488580:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.488606:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268045312:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.488641:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787790769.488646:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268044672:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.488672:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268045184:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790769.488730:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044800 00000100:00100000:3.0:1787790769.488733:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044800 00000100:00100000:3.0:1787790769.488767:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045312 00000100:00100000:3.0:1787790769.488770:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045312 00000100:00100000:3.0:1787790769.488781:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268044672 00000100:00100000:3.0:1787790769.488783:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268044672 00000100:00100000:3.0:1787790769.488793:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787790769.488799:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268044800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488844:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268044800:12345-0@lo:400:kworker.0 Request processed in 45us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.488850:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787790769.488862:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787790769.488868:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268045312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488898:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268045312:12345-0@lo:400:kworker.0 Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.488904:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787790769.488915:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787790769.488921:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268044672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.488946:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268044672:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790769.488953:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1787790769.488967:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790769.488994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268044672:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.489004:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268044800:0@lo:400:kworker.0 00000100:00100000:3.0:1787790769.489013:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268045312:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.489419:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268045440:12345-0@lo:400:kworker.0 Request processed in 1034us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790769.489427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:0.0:1787790769.489471:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f47480 x1874634268045440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790769.489484:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268045440:0@lo:400:kworker.0 00010000:00080000:0.0:1787790769.489510:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f47840 x1874634268044928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790769.489519:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268044928:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.489530:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268044544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.489581:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045056 00000100:00100000:0.0:1787790769.489586:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045056 00000100:00100000:0.0:1787790769.489634:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045184 00000100:00100000:0.0:1787790769.489637:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045184 00000100:00100000:0.0:1787790769.489659:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787790769.489665:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268045056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.489729:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268045056:12345-0@lo:400:kworker.0 Request processed in 64us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790769.489735:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787790769.489746:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787790769.489752:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790769.489783:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268045184:12345-0@lo:400:kworker.0 Request processed in 31us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790769.489789:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787790769.489817:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f46940 x1874634268045056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790769.489840:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268045056:0@lo:400:kworker.0 00000100:00080000:3.0:1787790769.489993:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790769.490016:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f45680 x1874634268045184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790769.490042:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268045184:0@lo:400:kworker.0 00000100:00100000:1.0:1787790769.490203:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268044416:0@lo:400:kworker.0 00010000:00010000:3.0:1787790769.994890:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790770.635265:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790770.635294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790770.635321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790770.635340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790770.635685:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790770.636450:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142976 00000100:00100000:0.0:1787790770.636462:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142976 00000100:00100000:0.0:1787790770.636523:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143232 00000100:00100000:0.0:1787790770.636526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143232 00000100:00100000:0.0:1787790770.636552:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143104 00000100:00100000:0.0:1787790770.636555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143104 00000100:00100000:0.0:1787790770.636568:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143360 00000100:00100000:0.0:1787790770.636571:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143360 00000100:00100000:0.0:1787790770.636588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 165 00000100:00100000:0.0:1787790770.636597:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250142976:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790770.636677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250142976:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 81us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790770.636684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 165 00000100:00100000:0.0:1787790770.636701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787790770.636727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250143232:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790770.636754:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250143232:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790770.636760:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787790770.636772:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 167 00000100:00100000:0.0:1787790770.636778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250143104:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790770.636802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250143104:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790770.636808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 167 00000100:00100000:0.0:1787790770.636835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 168 00000100:00100000:0.0:1787790770.636842:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250143360:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790770.636866:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250143360:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790770.636872:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 168 00000100:00100000:3.0:1787790770.639537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250142848 00000100:00100000:3.0:1787790770.639552:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250142848 00000100:00100000:3.0:1787790770.639607:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 309 00000100:00100000:3.0:1787790770.639618:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250142848:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790770.639691:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250142848:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 75us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790770.639699:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 309 00000100:00080000:3.0:1787790770.639763:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790770.639768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787790771.020107:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787790771.026529:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000020:00000080:0.0:1787790771.026548:0:9504:0:(genops.c:885:class_export_put()) final put ffff916fc1d24800/f47024d7-c694-4b5e-82d5-d65d38352c76 00000020:00000080:1.0:1787790771.026592:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1d24800/f47024d7-c694-4b5e-82d5-d65d38352c76 for lustre-OST0001 00000001:00100000:2.0:1787790771.026628:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000020:00000080:2.0:1787790771.026632:0:8420:0:(genops.c:885:class_export_put()) final put ffff9170ff55a000/f47024d7-c694-4b5e-82d5-d65d38352c76 00000020:00000080:1.0:1787790771.026643:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1d22000 for lustre-OST0001 00000020:00000080:1.0:1787790771.026659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ff55a000/f47024d7-c694-4b5e-82d5-d65d38352c76 for lustre-OST0000 00000020:00000080:1.0:1787790771.026679:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ff55c800 for lustre-OST0000 00010000:00010000:2.0:1787790772.042858:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790772.046216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790772.046243:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268045568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790772.046322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790772.046389:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045568 00000100:00100000:3.0:1787790772.046396:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045568 00000100:00100000:3.0:1787790772.046454:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787790772.046464:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268045568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787790772.046494:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790772.046542:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268045568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790772.046556:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787790772.046578:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790772.046611:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f44f00 x1874634268045568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790772.046631:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268045568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790772.050482:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790772.050505:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268045696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790772.050573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790772.050699:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045696 00000100:00100000:2.0:1787790772.050730:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045696 00000100:00100000:2.0:1787790772.050945:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787790772.050955:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268045696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790772.050979:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790772.051029:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268045696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.051037:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787790772.051076:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a06940 x1874634268045696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790772.051095:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268045696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787790772.051154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787790772.149053:0:13178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed85f0290 20000000:00000080:1.0:1787790772.149074:0:13178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff916fc3037c00 uarg=0000000000000000 20000000:01000000:1.0:1787790772.149121:0:13178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787790772.149128:0:13178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787790772.149133:0:13178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787790772.150421:0:13179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787790772.150957:0:13178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787790772.157381:0:13178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787790772.157421:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157441:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157450:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157458:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157465:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157472:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157479:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157487:0:13178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157553:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157570:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 12 pid: 6505 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.157585:0:13178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268045824:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790772.157924:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.157934:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.157944:0:13178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268045952:0@lo:104: 00000100:00100000:1.0:1787790772.158056:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790772.158148:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.158156:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.158165:0:13178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046080:0@lo:104: 00000100:00100000:1.0:1787790772.158189:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790772.159289:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.159302:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.159329:0:13178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37161c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046208:0@lo:104: 00000100:00100000:1.0:1787790772.159365:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790772.159425:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268045952 00000100:00100000:0.0:1787790772.159434:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268045952 00000100:00100000:0.0:1787790772.159518:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046080 00000100:00100000:0.0:1787790772.159522:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046080 00000100:00100000:0.0:1787790772.159537:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790772.159545:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a75db525-924f-489b-b982-1d04f64567fb+4:13178:x1874634268045952:12345-0@lo:104: 00010000:00010000:0.0:1787790772.159558:0:9513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.159609:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790772.159614:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a75db525-924f-489b-b982-1d04f64567fb+4:13178:x1874634268045952:12345-0@lo:104: Request processed in 71us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790772.159621:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787790772.159638:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787790772.159644:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a75db525-924f-489b-b982-1d04f64567fb+3:13178:x1874634268046080:12345-0@lo:104: 00010000:00010000:0.0:1787790772.159651:0:9513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.160128:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787790772.160136:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a75db525-924f-489b-b982-1d04f64567fb+3:13178:x1874634268046080:12345-0@lo:104: Request processed in 492us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790772.160143:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1787790772.160207:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790772.160214:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160222:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790772.160236:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160245:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790772.160252:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790772.160258:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790772.160299:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160307:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790772.160330:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160337:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1dacf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1dad6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160352:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790772.160355:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160360:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790772.160363:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160369:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790772.160386:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790772.160391:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790772.160406:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160412:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790772.160429:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160436:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1dac1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1dac8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160446:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790772.160447:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790772.160448:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790772.160476:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268046336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790772.160516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790772.160564:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268046464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790772.160587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790772.160618:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046336 00000100:00100000:2.0:1787790772.160622:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046336 00010000:00010000:2.0:1787790772.160642:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 24 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790772.160661:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046464 00000100:00100000:2.0:1787790772.160664:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046464 00010000:00010000:2.0:1787790772.160689:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 25 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790772.160741:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790772.160748:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+25:3639:x1874634268046336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.160759:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790772.160765:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 25 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160773:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 25 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160789:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790772.160830:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+25:3639:x1874634268046336:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.160837:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790772.160851:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790772.160857:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268046464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.160864:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790772.160869:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 24 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160877:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 24 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.160886:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790772.160912:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268046464:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.160918:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790772.161277:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268046464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790772.161317:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268046336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.161761:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790772.166219:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.166238:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.166252:0:13178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3717840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046592:0@lo:104: 00000100:00100000:1.0:1787790772.166308:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790772.166350:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790772.166360:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.166369:0:13178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2643c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046720:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790772.166420:0:13178:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787790772.166462:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030000/0xcf9477fddcf1dad6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1dacf expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.166481:0:13178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268045952:0@lo:104: 00010000:00010000:1.0:1787790772.166492:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030600/0xcf9477fddcf1dac8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1dac1 expref: 22 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.166499:0:13178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046080:0@lo:104: 00000100:00100000:2.0:1787790772.166570:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046208 00000100:00100000:2.0:1787790772.166577:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046208 00000100:00100000:2.0:1787790772.166622:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046592 00000100:00100000:2.0:1787790772.166625:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046592 00000100:00100000:2.0:1787790772.166641:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787790772.166650:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:13178:x1874634268046208:12345-0@lo:104: 00010000:00010000:2.0:1787790772.166664:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.166754:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790772.166761:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+4:13178:x1874634268046208:12345-0@lo:104: Request processed in 113us (7398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.166768:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787790772.166788:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790772.166793:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:13178:x1874634268046592:12345-0@lo:104: 00010000:00010000:2.0:1787790772.166801:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.166847:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790772.166852:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a75db525-924f-489b-b982-1d04f64567fb+3:13178:x1874634268046592:12345-0@lo:104: Request processed in 59us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.166858:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787790772.166875:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790772.166882:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.166911:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790772.166915:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.166924:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790772.166931:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790772.166936:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790772.166978:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.166985:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790772.167005:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167011:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0031600/0xcf9477fddcf1dab3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1daba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167025:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790772.167028:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167033:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790772.167035:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167051:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790772.167057:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790772.167061:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790772.167075:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167081:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790772.167094:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167100:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ea00/0xcf9477fddcf1daa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1daac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167112:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790772.167114:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790772.167115:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790772.167126:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268046848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790772.167154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790772.167188:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268046976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790772.167208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790772.167234:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046848 00000100:00100000:2.0:1787790772.167238:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046848 00010000:00010000:2.0:1787790772.167255:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 22 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790772.167287:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268046976 00000100:00100000:2.0:1787790772.167290:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268046976 00010000:00010000:2.0:1787790772.167302:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790772.167318:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790772.167324:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+23:3641:x1874634268046848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.167334:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790772.167339:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167349:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167366:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790772.167394:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+23:3641:x1874634268046848:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.167401:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790772.167414:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790772.167420:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+22:3638:x1874634268046976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.167428:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790772.167432:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 22 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167440:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 22 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.167451:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790772.167483:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+22:3638:x1874634268046976:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.167489:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790772.167526:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268046976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790772.167548:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268046848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.167567:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790772.167817:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1daba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1dab3 expref: 21 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.167836:0:13178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37161c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046208:0@lo:104: 00010000:00010000:1.0:1787790772.167849:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102178600/0xcf9477fddcf1daac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1daa5 expref: 20 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790772.167859:0:13178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3717840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046592:0@lo:104: 00000100:00100000:1.0:1787790772.169381:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790772.169467:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143488 00000100:00100000:2.0:1787790772.169476:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143488 00010000:00010000:2.0:1787790772.169516:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 13 pid: 6505 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790772.169555:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:2.0:1787790772.169564:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250143488:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790772.169577:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790772.169583:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 13 pid: 6505 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.169595:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 13 pid: 6505 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.169615:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790772.169674:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250143488:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790772.169682:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00010000:00010000:0.0:1787790772.169970:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031000/0xcf9477fddcf1daeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae8 expref: 12 pid: 6505 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790772.169985:0:13178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268045824:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790772.174366:0:13178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2643c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1874634268046720:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790772.174429:0:13178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790772.177433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790772.177480:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143616 00000100:00100000:0.0:1787790772.177489:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143616 00010000:00010000:0.0:1787790772.177530:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790772.177564:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:0.0:1787790772.177574:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c6461450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:2402:x1874634250143616:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790772.177591:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790772.177597:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177609:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177629:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1da9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa9 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177650:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177659:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177687:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177694:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177700:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177739:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177745:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790772.177750:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177758:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177772:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790772.177782:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790772.177844:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c6461450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:2402:x1874634250143616:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 270us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790772.177852:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00010000:00010000:2.0:1787790772.178004:0:13178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.178013:0:13178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790772.178020:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102178a00/0xcf9477fddcf1db0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.070867:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790773.071076:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268047104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790773.071152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.071260:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047104 00000100:00100000:0.0:1787790773.071279:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047104 00000100:00100000:0.0:1787790773.071344:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787790773.071355:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268047104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790773.071401:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787790773.071452:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268047104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790773.071459:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787790773.071734:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268047104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790773.072845:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268047232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790773.072896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.073028:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047232 00000100:00100000:0.0:1787790773.073034:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047232 00000100:00100000:0.0:1787790773.073081:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787790773.073099:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268047232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790773.073129:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790773.076609:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268047232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3500us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790773.076626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787790773.085120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268047232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790773.509658:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790773.509697:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143744 00000100:00100000:0.0:1787790773.509720:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143744 00000100:00100000:0.0:1787790773.510117:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 310 00000100:00100000:0.0:1787790773.510129:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:6170:x1874634250143744:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790773.510146:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790773.510164:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b19 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.510191:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.510199:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.510206:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030200, rc 0) 00000100:00100000:0.0:1787790773.510258:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250143744:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 132us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790773.510265:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 310 00000100:00100000:1.0:1787790773.517610:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790773.517834:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250143872 00000100:00100000:3.0:1787790773.517845:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250143872 00000100:00100000:3.0:1787790773.517911:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 311 00000100:00100000:3.0:1787790773.517922:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250143872:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790773.518105:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250143872:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 184us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.518114:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 311 00000100:00100000:1.0:1787790773.521730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790773.521775:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144000 00000100:00100000:0.0:1787790773.521785:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144000 00000100:00100000:0.0:1787790773.521850:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 312 00000100:00100000:0.0:1787790773.521862:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250144000:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.522004:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250144000:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 144us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790773.522013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 312 00000100:00100000:1.0:1787790773.534961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790773.535135:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144128 00000100:00100000:2.0:1787790773.535148:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144128 00000100:00100000:2.0:1787790773.535203:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 313 00000100:00100000:2.0:1787790773.535213:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250144128:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790773.535231:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790773.535250:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b20 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.535278:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.535290:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.535311:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790773.535380:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250144128:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 167us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.535388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 313 00000100:00100000:1.0:1787790773.537005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790773.537177:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144256 00000100:00100000:3.0:1787790773.537186:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144256 00000100:00100000:3.0:1787790773.537236:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 314 00000100:00100000:3.0:1787790773.537247:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250144256:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790773.537404:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250144256:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 157us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.537412:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 314 00000100:00100000:1.0:1787790773.544178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790773.544219:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144384 00000100:00100000:1.0:1787790773.544227:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144384 00000100:00100000:1.0:1787790773.544279:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 315 00000100:00100000:1.0:1787790773.544289:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250144384:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.544419:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250144384:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790773.544427:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 315 10000000:01000000:0.0:1787790773.706850:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790773.706860:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f67a4800 from 7 10000000:01000000:0.0:1787790773.706866:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790773.706928:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.707509:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.707523:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790773.707552:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.707634:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.707685:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.707844:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047360 00000100:00100000:2.0:1787790773.707852:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047360 00000100:00100000:2.0:1787790773.707932:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787790773.707940:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268047360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790773.707952:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790773.707965:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1db23 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.707985:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.707993:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.708000:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994e00, rc 0) 00000100:00100000:2.0:1787790773.708040:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268047360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.708045:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787790773.708157:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790773.708173:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.708182:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790773.708246:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.708273:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.710092:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790773.721972:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047488 00000100:00100000:1.0:1787790773.721986:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047488 00000100:00100000:1.0:1787790773.722053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787790773.722066:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268047488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.722264:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268047488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (13988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790773.722272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787790773.722500:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790773.722563:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790773.722614:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790773.722655:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.722695:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047616 00000100:00100000:2.0:1787790773.722702:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047616 00000100:00100000:2.0:1787790773.722759:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787790773.722767:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268047616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790773.722878:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268047616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.722886:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787790773.726269:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787790773.729661:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787790773.729763:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787790773.729804:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790773.729817:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.729829:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790773.729841:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790773.729844:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3c78800 from 7 10000000:01000000:0.0:1787790773.729847:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790773.729882:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.729888:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.729899:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790773.729922:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.729991:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.730024:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc27269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.730087:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047744 00000100:00100000:2.0:1787790773.730095:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047744 00000100:00100000:2.0:1787790773.730143:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787790773.730154:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268047744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790773.730166:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790773.730179:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1db31 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.730215:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.730225:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.730233:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994000, rc 0) 00000100:00100000:2.0:1787790773.730295:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268047744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.730303:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787790773.731066:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790773.731086:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790773.731096:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790773.731162:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.731200:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790773.731233:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.731526:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268047872 00000100:00100000:2.0:1787790773.731531:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268047872 00000100:00100000:2.0:1787790773.731565:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787790773.731573:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268047872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790773.731724:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268047872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.731742:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787790773.732570:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268047872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.732624:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.732677:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790773.732732:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.734626:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048000 00000100:00100000:2.0:1787790773.734642:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048000 00000100:00100000:2.0:1787790773.734740:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787790773.734752:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268048000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790773.734925:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268048000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.734933:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787790773.736202:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787790773.737198:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787790773.737359:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787790773.737387:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790773.737398:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.737409:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790773.737432:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790773.737435:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3e20800 from 7 10000000:01000000:0.0:1787790773.737438:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790773.737477:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.737485:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790773.737495:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790773.737518:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.737585:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.737629:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726780 going to sleep for 11 seconds 00000100:00100000:1.0:1787790773.740299:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048128 00000100:00100000:1.0:1787790773.740316:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048128 00000100:00100000:1.0:1787790773.740393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787790773.740404:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268048128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790773.740419:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790773.740437:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1db3f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790773.740465:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790773.740492:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790773.740501:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917102178600, rc 0) 00000100:00100000:1.0:1787790773.740588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268048128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790773.740596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787790773.740780:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790773.740828:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.740840:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790773.740922:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790773.740975:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790773.741012:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790773.741748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048256 00000100:00100000:1.0:1787790773.741755:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048256 00000100:00100000:1.0:1787790773.741804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787790773.741815:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268048256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.741942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268048256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790773.741948:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787790773.742329:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.742375:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.742422:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.742450:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc27260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790773.743034:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048384 00000100:00100000:1.0:1787790773.743039:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048384 00000100:00100000:1.0:1787790773.743077:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787790773.743086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268048384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.743177:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268048384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790773.743248:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787790773.743731:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790773.754213:0:13228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787790773.754529:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787790773.754558:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790773.754575:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790773.754588:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790773.754599:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790773.754602:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c2ab0800 from 7 10000000:01000000:3.0:1787790773.754606:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790773.754643:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790773.754662:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790773.754675:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790773.754732:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790773.754826:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790773.754873:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.755573:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048512 00000100:00100000:2.0:1787790773.755582:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048512 00000100:00100000:2.0:1787790773.755645:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787790773.755657:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268048512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790773.755672:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790773.755689:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1db4d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.755750:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.755762:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790773.755772:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994400, rc 0) 00000100:00100000:2.0:1787790773.755846:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268048512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.755856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787790773.755881:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790773.755904:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790773.755926:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790773.755994:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790773.756026:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790773.756055:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790773.756789:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048640 00000100:00100000:2.0:1787790773.756806:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048640 00000100:00100000:2.0:1787790773.756879:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787790773.756888:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268048640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790773.757039:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268048640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790773.757047:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787790773.757112:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.757157:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790773.757206:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790773.765884:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc27260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790773.766174:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048768 00000100:00100000:3.0:1787790773.766184:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048768 00000100:00100000:3.0:1787790773.766236:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787790773.766245:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268048768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790773.766398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268048768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (9191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790773.766406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787790773.768466:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268048768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790773.782662:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787790773.782953:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787790773.782980:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790773.782992:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790773.783004:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790774.090878:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790774.604030:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268048896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790774.604124:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790774.604298:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268048896 00000100:00100000:3.0:1787790774.604309:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268048896 00000100:00100000:3.0:1787790774.604388:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787790774.604400:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268048896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790774.604435:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790774.604490:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268048896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.604499:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1787790774.604559:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd2580 x1874634268048896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790774.604579:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268048896:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787790774.605106:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790774.609029:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268049024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790774.609106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.609177:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049024 00000100:00100000:1.0:1787790774.609184:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049024 00000100:00100000:1.0:1787790774.609241:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787790774.609250:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268049024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790774.609275:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790774.609320:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268049024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790774.609327:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787790774.609351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787790774.609382:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd1a40 x1874634268049024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790774.609400:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268049024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790774.609701:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268049280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.609766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790774.609799:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268049792:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.609821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790774.609840:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268050304:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.609866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790774.609887:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787790774.609892:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268049408:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.609916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.610025:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268049152:0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.613162:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268049664:0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.613244:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268050176:0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.613296:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787790774.613303:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268049536:0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.613340:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268050048:0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790774.613388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049152 00000100:00100000:1.0:1787790774.613395:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049152 00000100:00100000:1.0:1787790774.613439:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787790774.613447:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268049152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613494:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268049152:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790774.613501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787790774.613531:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050176 00000100:00100000:1.0:1787790774.613534:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050176 00000100:00100000:1.0:1787790774.613570:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050048 00000100:00100000:1.0:1787790774.613573:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050048 00000100:00100000:1.0:1787790774.613591:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790774.613597:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268050176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613624:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268050176:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790774.613630:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790774.613640:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787790774.613645:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268050048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613666:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268050048:12345-0@lo:400:kworker.0 Request processed in 22us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790774.613681:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787790774.613721:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790774.613748:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a56d00 x1874634268050048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790774.613763:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268050048:0@lo:400:kworker.0 00000100:00100000:1.0:1787790774.613772:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268049152:0@lo:400:kworker.0 00010000:00080000:1.0:1787790774.613781:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a56580 x1874634268050176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790774.613803:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268050176:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614164:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049280 00000100:00100000:3.0:1787790774.614169:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049280 00000100:00100000:3.0:1787790774.614204:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049792 00000100:00100000:3.0:1787790774.614208:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049792 00000100:00100000:3.0:1787790774.614231:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050304 00000100:00100000:3.0:1787790774.614234:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050304 00000100:00100000:3.0:1787790774.614246:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049664 00000100:00100000:3.0:1787790774.614248:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049664 00000100:00100000:3.0:1787790774.614261:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787790774.614267:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268049280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614310:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268049280:12345-0@lo:400:kworker.0 Request processed in 44us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614316:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787790774.614329:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787790774.614334:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268049792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614361:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268049792:12345-0@lo:400:kworker.0 Request processed in 27us (4539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614366:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787790774.614377:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787790774.614392:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614419:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268050304:12345-0@lo:400:kworker.0 Request processed in 29us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614425:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787790774.614436:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787790774.614442:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268049664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614476:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268049664:12345-0@lo:400:kworker.0 Request processed in 34us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614482:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787790774.614516:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049408 00000100:00100000:3.0:1787790774.614520:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049408 00000100:00100000:3.0:1787790774.614542:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049536 00000100:00100000:3.0:1787790774.614545:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049536 00000100:00100000:3.0:1787790774.614556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787790774.614561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268049408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614594:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268049408:12345-0@lo:400:kworker.0 Request processed in 32us (4677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787790774.614609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787790774.614614:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268049536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268049536:12345-0@lo:400:kworker.0 Request processed in 21us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614640:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787790774.614672:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268049536:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614681:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268049664:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614736:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268049408:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614744:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268049920:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790774.614796:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268049920 00000100:00100000:3.0:1787790774.614799:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268049920 00000100:00100000:3.0:1787790774.614819:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787790774.614824:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268049920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614849:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268049920:12345-0@lo:400:kworker.0 Request processed in 25us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.614855:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00010000:00080000:3.0:1787790774.614875:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a54780 x1874634268049920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790774.614885:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268049920:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614892:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268050432:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.614909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790774.614925:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050432 00000100:00080000:1.0:1787790774.616220:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790774.616228:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790774.616268:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050432 00000100:00100000:3.0:1787790774.616333:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787790774.616341:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268050432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.616396:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268050432:12345-0@lo:400:kworker.0 Request processed in 56us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790774.616403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00080000:3.0:1787790774.616435:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a57480 x1874634268050432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790774.616458:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268050432:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.616472:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268049280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.616482:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268049792:0@lo:400:kworker.0 00000100:00100000:3.0:1787790774.616492:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268050304:0@lo:400:kworker.0 00000100:00080000:1.0:1787790774.616573:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787790775.119679:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790775.750596:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790775.750640:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790775.750668:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790775.750689:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790775.750750:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790775.750793:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144768 00000100:00100000:2.0:1787790775.750802:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144768 00000100:00100000:2.0:1787790775.750868:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145024 00000100:00100000:2.0:1787790775.750872:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145024 00000100:00100000:2.0:1787790775.750887:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144640 00000100:00100000:2.0:1787790775.750889:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144640 00000100:00100000:2.0:1787790775.750900:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144896 00000100:00100000:2.0:1787790775.750902:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144896 00000100:00100000:2.0:1787790775.750917:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 175 00000100:00100000:2.0:1787790775.750932:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250144768:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790775.751006:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250144768:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790775.751014:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 175 00000100:00100000:2.0:1787790775.751033:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 176 00000100:00100000:2.0:1787790775.751039:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250145024:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790775.751063:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250145024:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790775.751069:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 176 00000100:00100000:2.0:1787790775.751080:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 177 00000100:00100000:2.0:1787790775.751086:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250144640:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790775.751123:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250144640:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 37us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790775.751129:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 177 00000100:00100000:2.0:1787790775.751141:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 178 00000100:00100000:2.0:1787790775.751147:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250144896:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790775.751188:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250144896:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 40us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790775.751194:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 178 00000100:00080000:2.0:1787790775.751219:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790775.751223:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790775.751690:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250144512 00000100:00100000:3.0:1787790775.751696:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250144512 00000100:00100000:3.0:1787790775.751757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 329 00000100:00100000:3.0:1787790775.751765:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250144512:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790775.751816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250144512:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 51us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790775.751822:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 329 00010000:00010000:3.0:1787790776.139220:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787790776.415946:0:13376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787790777.162945:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268050560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790777.163040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790777.163327:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050560 00000100:00100000:2.0:1787790777.163334:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050560 00000100:00100000:2.0:1787790777.163393:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787790777.163404:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268050560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790777.163431:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787790777.163519:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790777.163802:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268050688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790777.163835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790777.163878:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050688 00000100:00100000:3.0:1787790777.163882:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050688 00000100:00100000:3.0:1787790777.163909:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790777.163916:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268050688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790777.163927:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790777.163957:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268050688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790777.163964:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1787790777.164010:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790777.164031:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373d2c0 x1874634268050688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790777.164049:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268050688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790777.166330:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268050560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2921us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790777.166344:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1787790777.166438:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787790777.173671:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a55680 x1874634268050560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790777.173701:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268050560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790778.186906:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268050816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787790778.186947:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790778.186983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790778.187128:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790778.187139:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268050944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790778.187170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790778.187206:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050816 00000100:00100000:3.0:1787790778.187213:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268050944 00000100:00100000:2.0:1787790778.187214:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050816 00000100:00100000:3.0:1787790778.187217:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268050944 00000100:00100000:2.0:1787790778.187264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787790778.187274:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268050816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790778.187309:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790778.187417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268050816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790778.187466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268050816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790778.189888:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787790778.189922:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268050944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790778.189970:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787790778.190064:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268050944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790778.190073:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787790778.190232:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268050944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790778.191660:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:1.0:1787790779.216341:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790779.722913:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268051072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790779.722989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790779.723032:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051072 00000100:00100000:1.0:1787790779.723153:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268051328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790779.723157:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051072 00000100:00100000:1.0:1787790779.723184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790779.723239:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051328 00000100:00100000:3.0:1787790779.723243:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051328 00000100:00100000:1.0:1787790779.723254:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787790779.723263:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787790779.723263:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268051072:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790779.723268:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268051328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790779.723292:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787790779.723292:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790779.723333:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268051328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790779.723340:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787790779.723365:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268051200:0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.723395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787790779.723435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790779.723561:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268051072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 299us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790779.723569:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787790779.723588:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268051456:0@lo:400:kworker.0 00010000:00080000:1.0:1787790779.723602:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f47480 x1874634268051328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790779.723615:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790779.723619:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268051328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790779.723642:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051200 00000100:00100000:1.0:1787790779.723646:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051200 00000100:00100000:1.0:1787790779.723688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787790779.723693:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790779.723694:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268051200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.723698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268051840:0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.723767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790779.723767:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268051200:12345-0@lo:400:kworker.0 Request processed in 74us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790779.723774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787790779.723793:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051456 00000100:00100000:3.0:1787790779.723796:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051456 00000100:00100000:3.0:1787790779.723820:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051840 00000100:00100000:3.0:1787790779.723822:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051840 00000100:00100000:3.0:1787790779.723838:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787790779.723845:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268051456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.723957:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268051456:12345-0@lo:400:kworker.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790779.723964:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787790779.723977:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787790779.723982:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268051840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.723987:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268051456:0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.724010:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268051840:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790779.724013:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268051840:0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.724016:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00080000:2.0:1787790779.724075:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f443c0 x1874634268051072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790779.724101:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268051072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790779.724116:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268051584:0@lo:400:kworker.0 00000100:00100000:2.0:1787790779.724306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790779.724383:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790779.724391:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268051712:0@lo:400:kworker.0 00000100:00100000:2.0:1787790779.724412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790779.724441:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268051968:0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.724464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790779.724483:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268052480:0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.724502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790779.724518:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790779.724524:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268052352:0@lo:400:kworker.0 00000100:00100000:0.0:1787790779.724537:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268052224:0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.724557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790779.724584:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051968 00000100:00100000:1.0:1787790779.724586:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052352 00000100:00100000:1.0:1787790779.724588:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052352 00000100:00100000:0.0:1787790779.724588:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051968 00000100:00100000:0.0:1787790779.724620:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052480 00000100:00100000:1.0:1787790779.724622:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790779.724623:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052480 00000100:00100000:1.0:1787790779.724628:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268052352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790779.724640:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787790779.724646:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268051968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.724674:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268052352:12345-0@lo:400:kworker.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790779.724674:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268051968:12345-0@lo:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790779.724681:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790779.724681:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787790779.724693:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787790779.724699:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268052480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787790779.724700:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790779.724703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790779.724734:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373e1c0 x1874634268052352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790779.724754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268052352:0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.724765:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268051968:0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.724773:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268052480:0@lo:400:kworker.0 00000100:00100000:0.0:1787790779.724836:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268052480:12345-0@lo:400:kworker.0 Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790779.724844:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787790779.724931:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268052096:0@lo:400:kworker.0 00000100:00100000:0.0:1787790779.724938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790779.724953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790779.724962:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268051200:0@lo:400:kworker.0 00000100:00100000:2.0:1787790779.724966:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268052608:0@lo:400:kworker.0 00000100:00100000:0.0:1787790779.724980:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052224 00000100:00100000:0.0:1787790779.724984:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052224 00000100:00100000:2.0:1787790779.724986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790779.725008:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052096 00000100:00100000:0.0:1787790779.725009:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787790779.725011:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052096 00000100:00100000:0.0:1787790779.725015:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790779.725031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052608 00000100:00100000:2.0:1787790779.725034:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052608 00000100:00100000:2.0:1787790779.725051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787790779.725057:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268052096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.725182:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051584 00000100:00100000:3.0:1787790779.725186:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051584 00000100:00100000:3.0:1787790779.725207:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268051712 00000100:00100000:3.0:1787790779.725209:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268051712 00000100:00100000:3.0:1787790779.725219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787790779.725224:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268051584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790779.725271:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787790779.725278:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268051712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790779.725319:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268052224:12345-0@lo:400:kworker.0 Request processed in 303us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790779.725324:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268052096:12345-0@lo:400:kworker.0 Request processed in 267us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790779.725326:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787790779.725330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787790779.725341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787790779.725347:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268052608:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787790779.725349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790779.725351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790779.725367:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373fc00 x1874634268052224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790779.725376:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268052224:0@lo:400:kworker.0 00000100:00100000:3.0:1787790779.725390:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268051584:12345-0@lo:400:kworker.0 Request processed in 165us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790779.725405:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787790779.725486:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268051712:12345-0@lo:400:kworker.0 Request processed in 208us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790779.725492:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787790779.725537:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268052608:12345-0@lo:400:kworker.0 Request processed in 190us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790779.725542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00010000:00080000:2.0:1787790779.725572:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373c000 x1874634268052096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790779.725581:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268052096:0@lo:400:kworker.0 00010000:00080000:2.0:1787790779.725590:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373cb40 x1874634268052608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790779.725596:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268052608:0@lo:400:kworker.0 00000100:00100000:2.0:1787790779.725600:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268051712:0@lo:400:kworker.0 00000100:00100000:2.0:1787790779.725605:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268051584:0@lo:400:kworker.0 00010000:00010000:0.0:1787790780.238102:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787790780.789955:0:13525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:33:00 (1787790780) === 00000100:00100000:2.0:1787790780.877135:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790780.877211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790780.877243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790780.877271:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790780.877308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790780.877316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145152 00000100:00100000:1.0:1787790780.877328:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145152 00000100:00100000:2.0:1787790780.877335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145408 00000100:00100000:2.0:1787790780.877341:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145408 00000100:00100000:1.0:1787790780.877382:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 331 00000100:00100000:2.0:1787790780.877394:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145664 00000100:00100000:1.0:1787790780.877395:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250145152:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790780.877399:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145664 00000100:00100000:2.0:1787790780.877418:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145280 00000100:00100000:2.0:1787790780.877421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145280 00000100:00100000:2.0:1787790780.877439:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145536 00000100:00100000:2.0:1787790780.877454:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145536 00000100:00100000:1.0:1787790780.877468:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250145152:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.877478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 185 00000100:00100000:2.0:1787790780.877487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250145408:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790780.877522:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250145408:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.877529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 185 00000100:00100000:2.0:1787790780.877558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 186 00000100:00100000:2.0:1787790780.877565:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250145664:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790780.877597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250145664:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.877603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 186 00000100:00100000:2.0:1787790780.877616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 187 00000100:00100000:2.0:1787790780.877622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250145280:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790780.877650:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250145280:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.877657:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 187 00000100:00100000:2.0:1787790780.877668:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 188 00000100:00100000:2.0:1787790780.877675:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250145536:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790780.877701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250145536:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790780.877746:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 188 00000100:00080000:2.0:1787790780.877773:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790780.877778:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790780.877798:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 331 00000100:00100000:3.0:1787790780.972477:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790780.972515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790780.972559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145920 00000100:00100000:1.0:1787790780.972568:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145920 00000100:00100000:0.0:1787790780.972623:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250145792 00000100:00100000:0.0:1787790780.972628:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250145792 00000100:00100000:1.0:1787790780.972662:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:0.0:1787790780.972663:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:1.0:1787790780.972673:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a61a333f-852a-40de-8207-4f7de209a9a4+7:10488:x1874634250145920:12345-192.168.202.22@tcp:700:mkdir.0 00000100:00100000:0.0:1787790780.972673:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250145792:12345-192.168.202.22@tcp:41:mkdir.0 00000004:00000024:0.0:1787790780.972739:0:10094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790780.972779:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a61a333f-852a-40de-8207-4f7de209a9a4+7:10488:x1874634250145920:12345-192.168.202.22@tcp:700:mkdir.0 Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790780.972787:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:0.0:1787790780.972790:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250145792:12345-192.168.202.22@tcp:41:mkdir.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790780.972796:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:0.0:1787790780.979327:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790780.979502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250146176 00000100:00100000:1.0:1787790780.979511:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250146176 00000100:00100000:1.0:1787790780.979558:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:1.0:1787790780.979569:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:10488:x1874634250146176:12345-192.168.202.22@tcp:36:mkdir.0 00010000:00010000:1.0:1787790780.979620:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790780.979661:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1d9fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a94 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.979677:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3701000) 00010000:00010000:1.0:1787790780.979687:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790780.979808:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.979819:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.979826:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.979864:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.979880:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.979887:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980331:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980339:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980344:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790780.980355:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003050aa3 reply state 0000000019fa37b3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980363:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980369:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ec00) 00010000:00010000:1.0:1787790780.980372:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790780.980376:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787790780.980380:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787790780.980387:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980394:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980465:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980470:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790780.980473:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980478:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980485:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc268e900) 00010000:00010000:1.0:1787790780.980487:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790780.980489:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980493:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1db5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790780.980504:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003050aa3 reply state 0000000019fa37b3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980509:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790780.980512:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff916fc268e700) 00010000:00010000:1.0:1787790780.980514:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790780.980515:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787790780.980582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:10488:x1874634250146176:12345-192.168.202.22@tcp:36:mkdir.0 Request processed in 1015us (1265us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787790780.980588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:2.0:1787790780.988516:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790780.988568:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250146304 00000100:00100000:0.0:1787790780.988578:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250146304 00000100:00100000:0.0:1787790780.988628:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787790780.988639:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:10489:x1874634250146304:12345-192.168.202.22@tcp:101:chmod.0 00010000:00010000:0.0:1787790780.989148:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790780.989177:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1db70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b27 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.989272:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1db77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.989287:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1db77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.989300:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1db77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790780.989352:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790780.989357:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790780.989403:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1db77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.989432:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1db70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b27 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.989449:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1db77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b27 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790780.989457:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790780.989460:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790780.989464:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030000, rc 0) 00000100:00100000:0.0:1787790780.989529:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:10489:x1874634250146304:12345-192.168.202.22@tcp:101:chmod.0 Request processed in 891us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790780.989538:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:3.0:1787790780.992024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790780.992103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250146560 00000100:00100000:2.0:1787790780.992112:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250146560 00000100:00100000:2.0:1787790780.992187:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:2.0:1787790780.992195:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:10489:x1874634250146560:12345-192.168.202.22@tcp:36:chmod.0 00010000:00010000:2.0:1787790780.992240:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790780.992259:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1db77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b27 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.992289:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790780.992297:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790780.992317:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.992326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.992333:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790780.992520:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008e3f11c reply state 000000000545a340 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.992530:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790780.992535:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:2.0:1787790780.992537:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787790780.992539:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787790780.992545:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787790780.992615:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:10489:x1874634250146560:12345-192.168.202.22@tcp:36:chmod.0 Request processed in 421us (601us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787790780.992621:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:1.0:1787790781.016693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.017032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250146688 00000100:00100000:2.0:1787790781.017042:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250146688 00000100:00100000:2.0:1787790781.017098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:2.0:1787790781.017108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:10490:x1874634250146688:12345-192.168.202.22@tcp:101:chown.0 00010000:00010000:2.0:1787790781.017131:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790781.017167:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1db85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.017237:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1db8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.017250:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1db8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.017262:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1db8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790781.017306:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790781.017310:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790781.017348:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1db8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.017384:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1db85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b2e expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.017556:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1db8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b2e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.017565:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:2.0:1787790781.017568:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790781.017571:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995800, rc 0) 00000100:00100000:2.0:1787790781.017630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+10:10490:x1874634250146688:12345-192.168.202.22@tcp:101:chown.0 Request processed in 524us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790781.017639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:3.0:1787790781.026476:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.026760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250146816 00000100:00100000:0.0:1787790781.026771:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250146816 00000100:00100000:0.0:1787790781.026844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:0.0:1787790781.026863:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:10490:x1874634250146816:12345-192.168.202.22@tcp:101:chown.0 00010000:00010000:0.0:1787790781.026944:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790781.026966:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1db93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b35 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027028:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027041:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027052:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027062:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027068:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027074:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027152:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dba8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027161:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027168:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790781.027221:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790781.027224:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790781.027246:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027258:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027264:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027270:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027276:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790781.027280:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027287:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027298:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:0.0:1787790781.027301:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790781.027306:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027311:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1db9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027324:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027340:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027347:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027352:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790781.027355:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027361:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027850:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff916fc268e700) 00010000:00010000:0.0:1787790781.027853:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790781.027857:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027863:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dba1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027905:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1db93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b35 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027918:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b35 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.027924:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ec00) 00010000:00010000:0.0:1787790781.027926:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790781.027936:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030e00, rc 0) 00000100:00100000:0.0:1787790781.028004:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+11:10490:x1874634250146816:12345-192.168.202.22@tcp:101:chown.0 Request processed in 1150us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790781.028012:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:2.0:1787790781.032213:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790781.032320:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250146944 00000100:00100000:1.0:1787790781.032331:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250146944 00000100:00100000:1.0:1787790781.032391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787790781.032411:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a61a333f-852a-40de-8207-4f7de209a9a4+11:10490:x1874634250146944:12345-192.168.202.22@tcp:900:chown.0 00000100:00100000:1.0:1787790781.032494:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a61a333f-852a-40de-8207-4f7de209a9a4+11:10490:x1874634250146944:12345-192.168.202.22@tcp:900:chown.0 Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790781.032502:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787790781.036277:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.036383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250147200 00000100:00100000:2.0:1787790781.036392:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250147200 00000100:00100000:2.0:1787790781.036513:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787790781.036525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+11:10490:x1874634250147200:12345-192.168.202.22@tcp:36:chown.0 00010000:00010000:2.0:1787790781.036581:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790781.036611:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dba8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b35 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.036632:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ec00) 00010000:00010000:2.0:1787790781.036639:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790781.036664:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.036678:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.036688:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790781.039660:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1787790781.039852:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039865:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039887:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039893:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790781.039898:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039906:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039924:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff916fc268e700) 00010000:00010000:3.0:1787790781.039928:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790781.039932:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039938:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1db62 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039975:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039981:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039986:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039991:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790781.039994:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.039999:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040007:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ec00) 00010000:00010000:3.0:1787790781.040009:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790781.040012:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040017:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1db69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040030:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040036:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040042:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040054:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790781.040057:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040063:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040071:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:3.0:1787790781.040073:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787790781.040076:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.040083:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1db7e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790781.040363:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000824ff1ca reply state 000000006b5ebf31 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.040389:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.040403:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ec00) 00010000:00010000:1.0:1787790781.040406:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787790781.040410:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787790781.040421:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1787790781.040512:0:6513:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787790781.040536:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:10490:x1874634250147200:12345-192.168.202.22@tcp:36:chown.0 Request processed in 4010us (4268us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787790781.040545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00010000:00010000:0.0:1787790781.040688:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.040695:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.040701:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.040742:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790781.040746:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.040752:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.040761:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ec00) 00010000:00010000:0.0:1787790781.040763:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787790781.040766:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.040772:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1dbaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790781.058689:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790781.059058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250147328 00000100:00100000:1.0:1787790781.059070:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250147328 00000100:00100000:1.0:1787790781.059173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:1.0:1787790781.059185:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:10491:x1874634250147328:12345-192.168.202.22@tcp:101:touch.500 00010000:00010000:1.0:1787790781.059209:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790781.059242:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1dbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790781.064297:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5001us 00010000:00010000:1.0:1787790781.075614:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075639:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075653:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075670:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075678:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075685:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075845:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1dbcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075855:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075862:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790781.075903:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787790781.075913:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790781.075953:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075967:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075973:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075980:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075986:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790781.075990:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.075999:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076011:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:1.0:1787790781.076014:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790781.076019:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076025:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1dbbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076037:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076043:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076058:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076064:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790781.076066:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076073:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076080:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff916fc268e900) 00010000:00010000:1.0:1787790781.076083:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790781.076085:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076091:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1dbc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076130:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1dbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b3c expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076144:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1dbcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b3c expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.076151:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:1.0:1787790781.076153:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787790781.076156:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fae00, rc 0) 00000100:00100000:1.0:1787790781.076229:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:10491:x1874634250147328:12345-192.168.202.22@tcp:101:touch.500 Request processed in 17045us (17550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790781.076246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:2.0:1787790781.081459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.081570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250147584 00000100:00100000:0.0:1787790781.081580:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250147584 00000100:00100000:0.0:1787790781.081633:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:0.0:1787790781.081654:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:10491:x1874634250147584:12345-192.168.202.22@tcp:101:touch.500 00010000:00010000:0.0:1787790781.081673:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790781.081694:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dbd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b43 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.081839:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.081855:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.081865:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.081905:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.081913:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.081920:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790781.082260:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787790781.082387:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dbe7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082509:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082518:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082555:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082562:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082569:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082574:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790781.082578:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082585:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082597:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:0.0:1787790781.082600:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790781.082604:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082611:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dbd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790781.082622:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9e7d2b reply state 00000000cd73ece2 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082631:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082637:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff9170d638a700) 00010000:00010000:0.0:1787790781.082643:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790781.082646:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787790781.082674:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dbd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b43 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082687:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b43 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.082694:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638ad00) 00010000:00010000:0.0:1787790781.082696:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790781.082698:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030e00, rc 0) 00000100:00100000:0.0:1787790781.082805:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:10491:x1874634250147584:12345-192.168.202.22@tcp:101:touch.500 Request processed in 1152us (1355us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787790781.082813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:1.0:1787790781.087188:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.087558:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250147840 00000100:00100000:0.0:1787790781.087569:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250147840 00000100:00100000:0.0:1787790781.087633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:0.0:1787790781.087643:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+10:10491:x1874634250147840:12345-192.168.202.22@tcp:36:touch.500 00010000:00010000:0.0:1787790781.089889:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790781.089930:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dbe7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b43 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.089950:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638ad00) 00010000:00010000:0.0:1787790781.089961:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790781.090043:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.090057:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.090073:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790781.090177:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078b7b4d2 reply state 00000000efeec99a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.090190:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.090196:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:0.0:1787790781.090199:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790781.090202:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790781.090319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+11:10491:x1874634250147840:12345-192.168.202.22@tcp:36:touch.500 Request processed in 2676us (3140us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787790781.090328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:1.0:1787790781.094349:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.094589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250147968 00000100:00100000:2.0:1787790781.094600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250147968 00000100:00100000:2.0:1787790781.094661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:2.0:1787790781.094671:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+11:10491:x1874634250147968:12345-192.168.202.22@tcp:101:touch.500 00010000:00010000:2.0:1787790781.094697:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790781.094768:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1dbfc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.094864:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1dbfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b4a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.095040:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1dbfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b4a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.095062:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:2.0:1787790781.095065:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790781.095069:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995400, rc 0) 00000100:00100000:2.0:1787790781.095128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+12:10491:x1874634250147968:12345-192.168.202.22@tcp:101:touch.500 Request processed in 458us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790781.095136:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:2.0:1787790781.100164:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790781.100251:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250148096 00000100:00100000:1.0:1787790781.100261:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250148096 00000100:00100000:1.0:1787790781.100309:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:1.0:1787790781.100317:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1874634250148096:12345-192.168.202.22@tcp:8:touch.500 00010000:00080000:1.0:1787790781.100353:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:1.0:1787790781.100404:0:8427:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1dc03 00002000:00100000:1.0:1787790781.100418:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a61a333f-852a-40de-8207-4f7de209a9a4/ffff9170ff558800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787790781.100436:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787790781.100511:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787790781.100539:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9170ff55d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790781.100606:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250148096:12345-192.168.202.22@tcp:8:touch.500 Request processed in 287us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790781.100614:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:1.0:1787790781.104596:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.104694:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250148224 00000100:00100000:0.0:1787790781.104747:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250148224 00000100:00100000:0.0:1787790781.104815:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:0.0:1787790781.104825:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250148224:12345-192.168.202.22@tcp:2:touch.500 00000100:00080000:2.0:1787790781.105110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787790781.114996:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1787790781.115010:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000100:00100000:0.0:1787790781.117044:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:0:x1874634250148224:12345-192.168.202.22@tcp:2:touch.500 Request processed in 12211us (12451us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787790781.117059:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:0.0:1787790781.120599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.120789:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250148480 00000100:00100000:2.0:1787790781.120800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250148480 00000100:00100000:2.0:1787790781.120967:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:2.0:1787790781.120981:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+12:10491:x1874634250148480:12345-192.168.202.22@tcp:35:touch.500 00000100:00100000:2.0:1787790781.121275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+13:10491:x1874634250148480:12345-192.168.202.22@tcp:35:touch.500 Request processed in 298us (691us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787790781.121281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:2.0:1787790781.137865:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.137977:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250148608 00000100:00100000:0.0:1787790781.137989:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250148608 00000100:00100000:0.0:1787790781.138055:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:0.0:1787790781.138067:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+13:10492:x1874634250148608:12345-192.168.202.22@tcp:101:rm.0 00010000:00010000:0.0:1787790781.138107:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790781.138130:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b51 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.138203:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dc11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.138219:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.138230:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790781.138271:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790781.138275:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790781.138329:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.138356:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b51 expref: 15 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.138374:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b51 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.138381:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:0.0:1787790781.138384:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790781.138388:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0031000, rc 0) 00000100:00100000:0.0:1787790781.138464:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+14:10492:x1874634250148608:12345-192.168.202.22@tcp:101:rm.0 Request processed in 399us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790781.138471:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:1.0:1787790781.158823:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790781.159010:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250148864 00000100:00100000:3.0:1787790781.159021:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250148864 00000100:00100000:3.0:1787790781.159084:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:3.0:1787790781.159095:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:10492:x1874634250148864:12345-192.168.202.22@tcp:101:rm.0 00010000:00010000:3.0:1787790781.159114:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790781.159134:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dc18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b58 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790781.159235:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787790781.159385:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dc18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b58 expref: 16 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.159484:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:3.0:1787790781.159487:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790781.159494:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dc18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b58 expref: 16 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790781.159508:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e000, rc 0) 00000100:00100000:3.0:1787790781.159572:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+15:10492:x1874634250148864:12345-192.168.202.22@tcp:101:rm.0 Request processed in 479us (759us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1787790781.159580:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:2.0:1787790781.164795:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790781.164985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250148992 00000100:00100000:3.0:1787790781.164996:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250148992 00000100:00100000:3.0:1787790781.165054:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787790781.165065:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+15:10492:x1874634250148992:12345-192.168.202.22@tcp:37:rm.0 00000100:00100000:3.0:1787790781.172404:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+15:10492:x1874634250148992:12345-192.168.202.22@tcp:37:rm.0 Request processed in 7320us (7599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790781.172421:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:1.0:1787790781.176234:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.176323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250149248 00000100:00100000:2.0:1787790781.176334:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250149248 00000100:00100000:2.0:1787790781.176543:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787790781.176554:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+15:10492:x1874634250149248:12345-192.168.202.22@tcp:35:rm.0 00000100:00100000:2.0:1787790781.176793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:10492:x1874634250149248:12345-192.168.202.22@tcp:35:rm.0 Request processed in 239us (569us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787790781.176801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787790781.179358:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.179541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250149504 00000100:00100000:0.0:1787790781.179550:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250149504 00000100:00100000:0.0:1787790781.179636:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:0.0:1787790781.179644:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+16:10492:x1874634250149504:12345-192.168.202.22@tcp:101:rm.0 00010000:00010000:0.0:1787790781.179664:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790781.179680:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b5f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.179811:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dc2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.179822:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dc2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.179831:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dc2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790781.179839:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787790781.180105:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b5f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.180118:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dc2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b5f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.180124:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:0.0:1787790781.180126:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790781.180128:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c0030e00, rc 0) 00000100:00100000:0.0:1787790781.180205:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250149504:12345-192.168.202.22@tcp:101:rm.0 Request processed in 563us (857us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787790781.180219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:1.0:1787790781.182686:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.182823:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250149632 00000100:00100000:0.0:1787790781.182834:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250149632 00000100:00100000:0.0:1787790781.183013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:0.0:1787790781.183023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250149632:12345-192.168.202.22@tcp:41:rm.0 00000004:00000024:0.0:1787790781.183083:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787790781.183157:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250149632:12345-192.168.202.22@tcp:41:rm.0 Request processed in 135us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790781.183164:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:1.0:1787790781.189203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.189247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250149760 00000100:00100000:2.0:1787790781.189259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250149760 00000100:00100000:2.0:1787790781.189310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:2.0:1787790781.189318:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250149760:12345-192.168.202.22@tcp:101:rm.0 00010000:00010000:2.0:1787790781.189338:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790781.189361:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189556:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189571:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189583:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189595:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189602:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189609:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189695:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189701:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189819:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790781.189853:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787790781.189857:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790781.189874:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189885:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189893:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189899:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189905:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189911:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790781.189915:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189923:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189939:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:2.0:1787790781.189942:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790781.189945:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189950:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189958:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189962:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189965:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189969:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790781.189970:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189974:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189977:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff9170d638a700) 00010000:00010000:2.0:1787790781.189978:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790781.189980:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.189983:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.190009:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b66 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.190017:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b66 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.190022:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:2.0:1787790781.190024:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790781.190026:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995c00, rc 0) 00000100:00100000:2.0:1787790781.190075:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+19:10492:x1874634250149760:12345-192.168.202.22@tcp:101:rm.0 Request processed in 759us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790781.190081:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:2.0:1787790781.195273:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790781.195402:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250150016 00000100:00100000:0.0:1787790781.195412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250150016 00000100:00100000:0.0:1787790781.195479:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:0.0:1787790781.195490:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:10492:x1874634250150016:12345-192.168.202.22@tcp:36:rm.0 00010000:00010000:0.0:1787790781.195543:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787790781.195572:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1dc50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b66 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195598:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1dbfc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b4a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195609:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:0.0:1787790781.195620:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031000/0xcf9477fddcf1dc11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b51 expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195626:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:0.0:1787790781.195640:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790781.195657:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195667:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195674:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195681:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195686:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195690:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195807:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195816:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.195828:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790781.196065:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787790781.196074:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330144368244ns, next at 331144366276ns, rc = 0 00010000:00010000:0.0:1787790781.196116:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196134:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196142:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196149:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196155:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196161:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196189:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790781.196205:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196211:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196217:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196223:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790781.196227:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196235:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196255:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:0.0:1787790781.196257:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787790781.196262:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196267:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dc65 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196283:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196290:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196295:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196300:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790781.196303:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196308:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196314:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:0.0:1787790781.196316:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790781.196319:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196325:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031200/0xcf9477fddcf1dc57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790781.196345:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000407865e6 reply state 0000000053d3e046 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196356:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790781.196362:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff9170d638a700) 00010000:00010000:0.0:1787790781.196364:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790781.196366:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790781.196450:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250150016:12345-192.168.202.22@tcp:36:rm.0 Request processed in 961us (1187us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787790781.196460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00010000:00010000:1.0:1787790781.197946:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790781.197958:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.197967:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790781.197982:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.197991:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.198006:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:1.0:1787790781.198008:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787790781.198012:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.198018:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dc6c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790781.198033:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790781.198035:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790781.198036:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790781.201996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.202041:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250150272 00000100:00100000:2.0:1787790781.202052:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250150272 00000100:00100000:2.0:1787790781.202109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:2.0:1787790781.202116:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250150272:12345-192.168.202.22@tcp:35:rm.0 00000100:00100000:2.0:1787790781.202296:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:10492:x1874634250150272:12345-192.168.202.22@tcp:35:rm.0 Request processed in 180us (308us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787790781.202305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787790781.206175:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790781.206243:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250150528 00000100:00100000:2.0:1787790781.206252:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250150528 00000100:00100000:2.0:1787790781.206302:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:2.0:1787790781.206312:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+19:10492:x1874634250150528:12345-192.168.202.22@tcp:36:rm.0 00010000:00010000:2.0:1787790781.206382:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787790781.206422:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030e00/0xcf9477fddcf1dc2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b5f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206443:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1dbcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b3c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206455:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc268ef00) 00010000:00010000:2.0:1787790781.206471:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1db8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b2e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206480:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:2.0:1787790781.206486:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790781.206507:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206518:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206524:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206531:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206549:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206555:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206630:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206640:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206644:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790781.206971:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787790781.206987:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.206994:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207000:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207005:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790781.207009:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207016:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207025:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff916fc3700500) 00010000:00010000:2.0:1787790781.207028:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787790781.207031:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207038:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1dc81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207054:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207067:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207072:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207077:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790781.207081:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207087:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207095:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700800) 00010000:00010000:2.0:1787790781.207097:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790781.207100:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207106:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dc73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790781.207118:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009338a730 reply state 00000000e0f20b0a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207128:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790781.207133:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff916fc3700200) 00010000:00010000:2.0:1787790781.207135:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787790781.207138:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790781.207213:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+18:10492:x1874634250150528:12345-192.168.202.22@tcp:36:rm.0 Request processed in 901us (1044us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787790781.207226:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00010000:00010000:1.0:1787790781.259260:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790782.282887:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790782.283067:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268052736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790782.283144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790782.283252:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268052864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790782.283280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790782.287071:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052736 00000100:00100000:1.0:1787790782.287087:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052736 00000100:00100000:1.0:1787790782.287142:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052864 00000100:00100000:1.0:1787790782.287145:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052864 00000100:00100000:1.0:1787790782.287165:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787790782.287174:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268052736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787790782.287206:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790782.287280:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268052736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790782.287296:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787790782.287314:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787790782.287320:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268052864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790782.287331:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790782.287372:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268052864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790782.287378:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787790782.287395:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790782.287429:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bde00 x1874634268052736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790782.287488:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268052736:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787790782.291490:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4d5bc00 x1874634268052864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790782.291512:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268052864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790783.308834:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790783.308870:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268052992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790783.308975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790783.310115:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790783.311813:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268053120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790783.311908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790783.311980:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268052992 00000100:00100000:3.0:1787790783.311989:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268052992 00000100:00100000:3.0:1787790783.312032:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053120 00000100:00100000:3.0:1787790783.312036:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053120 00000100:00100000:3.0:1787790783.312052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787790783.312059:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268052992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787790783.312103:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787790783.312154:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268052992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (3180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790783.312161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787790783.312177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787790783.312183:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268053120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790783.312199:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787790783.312229:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268053120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790783.312235:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787790783.312279:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268053120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790783.312311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268052992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787790784.336881:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787790784.842956:0:9995:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333791247467ns, next at 334791244772ns, rc = 0 00000100:00100000:2.0:1787790784.843132:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790784.843156:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268053248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790784.843229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.843297:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053248 00000100:00100000:2.0:1787790784.843304:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053248 00000100:00100000:2.0:1787790784.843360:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787790784.843369:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268053248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790784.843400:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790784.843442:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268053248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.843450:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787790784.843470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787790784.843630:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bf480 x1874634268053248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790784.843647:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268053248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790784.845092:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268053376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790784.845147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790784.845329:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053376 00000100:00100000:1.0:1787790784.845337:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053376 00000100:00100000:1.0:1787790784.845409:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787790784.845419:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268053376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790784.845440:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790784.845482:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268053376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790784.845489:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787790784.846662:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787790784.846744:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bf480 x1874634268053376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790784.846768:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268053376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790784.847328:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268053632:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.847425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.847465:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268054144:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.847488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.848209:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268054656:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.848271:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787790784.848278:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268053760:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.848328:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268054272:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.848364:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268054784:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790784.848413:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053632 00000100:00100000:2.0:1787790784.848419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053632 00000100:00100000:2.0:1787790784.848478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054144 00000100:00100000:2.0:1787790784.848482:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054144 00000100:00100000:2.0:1787790784.848521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054656 00000100:00100000:2.0:1787790784.848525:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054656 00000100:00100000:2.0:1787790784.848557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054272 00000100:00100000:2.0:1787790784.848560:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054272 00000100:00100000:2.0:1787790784.848591:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054784 00000100:00100000:2.0:1787790784.848594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054784 00000100:00100000:2.0:1787790784.848611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787790784.848618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268053632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268053632:12345-0@lo:400:kworker.0 Request processed in 64us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.848689:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787790784.848741:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787790784.848748:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268054144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848779:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268054144:12345-0@lo:400:kworker.0 Request processed in 32us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.848785:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787790784.848796:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787790784.848802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268054656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.848828:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268054656:12345-0@lo:400:kworker.0 Request processed in 27us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.848834:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787790784.848845:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787790784.848850:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268054272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790784.848964:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787790784.848974:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790784.849008:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268054784:12345-0@lo:400:kworker.0 Request processed in 38us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790784.849019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787790784.849388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053760 00000100:00100000:0.0:1787790784.849393:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053760 00000100:00100000:0.0:1787790784.849423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787790784.849429:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268053760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.849465:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268053760:12345-0@lo:400:kworker.0 Request processed in 37us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790784.849471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787790784.849489:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268053504:0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.849521:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790784.849547:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268054016:0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.849568:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790784.850115:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268054528:0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.850144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790784.850165:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787790784.850176:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268053888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.850200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790784.850218:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268054400:0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.850238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790784.850264:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053504 00000100:00100000:0.0:1787790784.850269:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053504 00000100:00100000:0.0:1787790784.850295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787790784.850302:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268053504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.850338:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268053504:12345-0@lo:400:kworker.0 Request processed in 36us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790784.850344:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787790784.850369:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268053888 00000100:00100000:0.0:1787790784.850372:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268053888 00000100:00100000:0.0:1787790784.850392:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787790784.850398:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268053888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.850426:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268053888:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790784.850431:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787790784.850463:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268053888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790784.850473:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268053504:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.850592:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268054272:12345-0@lo:400:kworker.0 Request processed in 1741us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.850600:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787790784.850615:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054016 00000100:00100000:2.0:1787790784.850618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054016 00000100:00100000:2.0:1787790784.850653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787790784.850676:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268054016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.850739:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268054016:12345-0@lo:400:kworker.0 Request processed in 64us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.850745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787790784.850763:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054528 00000100:00100000:2.0:1787790784.850767:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054528 00000100:00100000:2.0:1787790784.850800:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054400 00000100:00100000:2.0:1787790784.850804:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054400 00000100:00100000:2.0:1787790784.850825:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787790784.850831:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268054528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790784.850964:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787790784.850975:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268054400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790784.851008:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268054400:12345-0@lo:400:kworker.0 Request processed in 37us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790784.851015:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787790784.851295:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268054528:12345-0@lo:400:kworker.0 Request processed in 34us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790784.851305:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1787790784.851342:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbf1b0c0 x1874634268054400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790784.851354:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268054400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.851365:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268054016:0@lo:400:kworker.0 00010000:00080000:2.0:1787790784.851374:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbf18b40 x1874634268054528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790784.851382:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268054528:0@lo:400:kworker.0 00000100:00080000:2.0:1787790784.851408:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790784.851412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790784.851414:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790784.851431:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268053760:0@lo:400:kworker.0 00010000:00080000:2.0:1787790784.851443:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbf18780 x1874634268054272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790784.851458:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268054272:0@lo:400:kworker.0 00010000:00080000:2.0:1787790784.851471:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe652c0 x1874634268054784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790784.851479:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268054784:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.851502:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268053632:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.851515:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268054144:0@lo:400:kworker.0 00000100:00100000:2.0:1787790784.851526:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268054656:0@lo:400:kworker.0 00000001:02000400:3.0:1787790785.134169:0:13674:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787790785.355095:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790785.988256:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790785.988312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790785.988359:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790785.988386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790785.988429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250150912 00000100:00100000:3.0:1787790785.988440:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250150912 00000100:00100000:3.0:1787790785.988524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151168 00000100:00100000:3.0:1787790785.988528:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151168 00000100:00100000:3.0:1787790785.988546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250150784 00000100:00100000:3.0:1787790785.988549:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250150784 00000100:00100000:3.0:1787790785.988568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 195 00000100:00100000:3.0:1787790785.988576:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250150912:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790785.988655:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3795680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250150912:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 80us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.988662:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 195 00000100:00100000:2.0:1787790785.988991:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250150656 00000100:00100000:2.0:1787790785.988996:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250150656 00000100:00100000:2.0:1787790785.989028:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 333 00000100:00100000:2.0:1787790785.989036:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250150656:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790785.989066:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250150656:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790785.989072:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 333 00000100:00100000:3.0:1787790785.989153:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 196 00000100:00100000:3.0:1787790785.989161:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250151168:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790785.989190:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250151168:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 30us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.989197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 196 00000100:00100000:3.0:1787790785.989209:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 197 00000100:00100000:3.0:1787790785.989215:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:2403:x1874634250150784:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790785.989240:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:2403:x1874634250150784:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.989246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 197 00000100:00080000:3.0:1787790785.989263:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790785.989266:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790785.991310:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790785.995271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790785.995310:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151296 00000100:00100000:3.0:1787790785.995321:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151296 00000100:00100000:3.0:1787790785.995385:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 198 00000100:00100000:3.0:1787790785.995395:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250151296:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790785.995483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250151296:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790785.995492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 198 00000100:00080000:3.0:1787790785.995517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790785.999510:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151040 00000100:00100000:2.0:1787790785.999522:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151040 00000100:00080000:3.0:1787790786.001890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790786.004048:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:2.0:1787790786.004067:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250151040:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790786.004163:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250151040:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 103us (12862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.004172:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 72 00000020:00000080:0.0:1787790786.275121:0:13722:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5d12f9d0 20000000:00000080:0.0:1787790786.275136:0:13722:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9170f3da8400 uarg=0000000000000000 20000000:01000000:0.0:1787790786.275172:0:13722:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787790786.275178:0:13722:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787790786.275181:0:13722:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787790786.276194:0:13723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787790786.276272:0:13722:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787790786.281320:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787790786.281374:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787790786.281391:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787790786.281407:0:13722:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790786.281426:0:13722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281446:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281454:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281463:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281471:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281478:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281485:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281512:0:13722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281550:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.281567:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.281583:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268054912:0@lo:104: 00000100:00100000:3.0:1787790786.281656:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790786.281945:0:9513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787790786.281960:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268054912 00000100:00100000:1.0:1787790786.281967:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268054912 00000100:00100000:1.0:1787790786.282034:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787790786.282043:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a75db525-924f-489b-b982-1d04f64567fb+3:13722:x1874634268054912:12345-0@lo:104: 00010000:00010000:1.0:1787790786.282056:0:9513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.283081:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790786.283092:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a75db525-924f-489b-b982-1d04f64567fb+3:13722:x1874634268054912:12345-0@lo:104: Request processed in 1049us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.283100:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787790786.283222:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790786.283240:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283248:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790786.283252:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283260:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790786.283267:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790786.283272:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790786.283319:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283326:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790786.283354:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283362:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ee00/0xcf9477fddcf1db4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283375:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790786.283377:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790786.283379:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790786.283387:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790786.283400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268055040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790786.283440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790786.283483:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268055040 00000100:00100000:2.0:1787790786.283494:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268055040 00010000:00010000:2.0:1787790786.283517:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 24 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.283543:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787790786.283550:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268055040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790786.283832:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790786.283839:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 24 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283851:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 24 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.283871:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790786.283947:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268055040:12345-0@lo:103:ldlm_bl.0 Request processed in 397us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.283954:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790786.284147:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268055040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790786.284160:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.284172:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284182:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055168:0@lo:104: 00000100:00100000:0.0:1787790786.284210:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790786.284238:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.284246:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 23 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284253:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055296:0@lo:104: 00000004:00080000:3.0:1787790786.284271:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787790786.284271:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1787790786.284296:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:0.0:1787790786.284299:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790786.284305:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787790786.284307:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 23 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284314:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055424:0@lo:104: 00000100:00100000:0.0:1787790786.284333:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790786.284355:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.284364:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 12 pid: 6507 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284369:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284373:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055552:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790786.284377:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284383:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284389:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790786.284392:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284399:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284421:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff9170d638a700) 00010000:00010000:3.0:1787790786.284425:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790786.284429:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284430:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284437:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0031600/0xcf9477fddcf1dbe0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.284438:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 12 pid: 6506 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284446:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055680:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790786.284465:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284466:0:13722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbedfcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787790786.284472:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284478:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.284479:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994400/0xcf9477fddcf1db54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1db4d expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284484:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790786.284487:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.284489:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268054912:0@lo:104: 00010000:00010000:3.0:1787790786.284494:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284501:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9170d638a400) 00010000:00010000:3.0:1787790786.284504:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790786.284507:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284513:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c0030000/0xcf9477fddcf1dbf5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284542:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284548:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284553:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284576:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165e800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790786.284580:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284586:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284593:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff9170d638a700) 00010000:00010000:3.0:1787790786.284596:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790786.284598:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284604:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1dc5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284631:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284638:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284644:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284818:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790786.284822:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284829:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284838:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff916fc3700200) 00010000:00010000:3.0:1787790786.284840:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790786.284843:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.284848:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1dc7a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.285149:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268055168 00000100:00100000:2.0:1787790786.285154:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268055168 00000100:00100000:2.0:1787790786.285180:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268055296 00000100:00100000:2.0:1787790786.285183:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268055296 00000100:00100000:2.0:1787790786.285195:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268055424 00000100:00100000:2.0:1787790786.285197:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268055424 00000100:00100000:2.0:1787790786.285208:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790786.285215:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+5:13722:x1874634268055168:12345-0@lo:104: 00010000:00010000:2.0:1787790786.285226:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285281:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790786.285288:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+5:13722:x1874634268055168:12345-0@lo:104: Request processed in 74us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.285301:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790786.285317:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790786.285323:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:13722:x1874634268055296:12345-0@lo:104: 00010000:00010000:2.0:1787790786.285331:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285364:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790786.285369:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+4:13722:x1874634268055296:12345-0@lo:104: Request processed in 46us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.285375:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790786.285387:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787790786.285393:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:13722:x1874634268055424:12345-0@lo:104: 00010000:00010000:2.0:1787790786.285400:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285438:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787790786.285444:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a75db525-924f-489b-b982-1d04f64567fb+3:13722:x1874634268055424:12345-0@lo:104: Request processed in 51us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.285450:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1787790786.285453:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787790786.285458:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285463:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790786.285465:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030600 already unused, calling callback (ffffffffc11c1c20) 00010000:00010000:2.0:1787790786.285466:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790786.285469:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285473:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0031e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790786.285476:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.285477:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790786.285484:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790786.285491:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790786.285492:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790786.285498:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790786.285503:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790786.285516:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.285516:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285523:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790786.285531:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790786.285541:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.285544:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285549:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0031e00/0xcf9477fddcf1db31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db38 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.285551:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030600/0xcf9477fddcf1db3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.285565:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790786.285569:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.285574:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790786.285576:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790786.285578:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790786.285586:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790786.285597:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268055808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790786.285625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790786.285659:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268055808 00000100:00100000:0.0:1787790786.285662:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268055808 00010000:00010000:0.0:1787790786.285690:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.286066:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787790786.286074:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+23:3639:x1874634268055808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790786.286083:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790786.286088:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.286098:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055168:0@lo:104: 00010000:00010000:0.0:1787790786.286099:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.286108:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055296:0@lo:104: 00010000:00010000:0.0:1787790786.286112:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917102178600/0xcf9477fddcf1db46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1db3f expref: 23 pid: 6506 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790786.286114:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055424:0@lo:104: 00010000:00010000:0.0:1787790786.286135:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790786.286171:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+22:3639:x1874634268055808:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790786.286177:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787790786.286424:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268055808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790786.286598:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268056064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787790786.286632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790786.286698:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056064 00010000:00010000:1.0:1787790786.286772:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790786.286783:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268055936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790786.286810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790786.287008:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056064 00000100:00100000:0.0:1787790786.287100:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787790786.287109:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268056064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787790786.287133:0:10092:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1787790786.287166:0:10092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f85be, atime: 0x6a8f85be, ctime: 0x6a8f85be, blocks: 0x0 00010000:00010000:0.0:1787790786.287173:0:10092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.287188:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1787790786.287192:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790786.287199:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.287215:0:10092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287221:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c0030a00 already unused, calling callback (ffffffffc11c1c20) 00010000:00010000:0.0:1787790786.287224:0:10092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790786.287225:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.287232:0:10092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287234:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790786.287242:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790786.287253:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787790786.287262:0:10092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790786.287278:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287284:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790786.287297:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287303:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030a00/0xcf9477fddcf1db23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1db2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287318:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790786.287322:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287328:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790786.287331:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287339:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287351:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287358:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1dc8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.287381:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790786.287382:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790786.287384:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790786.287406:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268056064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 298us (772us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787790786.287413:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790786.287422:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268055936 00000100:00100000:3.0:1787790786.287426:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268055936 00010000:00010000:3.0:1787790786.287444:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 22 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790786.287447:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170fbe670c0/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787790786.287452:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268056064:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787790786.287462:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790786.287464:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787790786.287477:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+22:3641:x1874634268055936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790786.287486:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790786.287491:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 22 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.287499:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 22 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.287511:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1db38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1db31 expref: 22 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790786.287521:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790786.287545:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+21:3641:x1874634268055936:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (734us total) trans 0 rc 0/0 00000100:00080000:1.0:1787790786.287548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790786.287551:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787790786.287752:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268056192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790786.287781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790786.287834:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268055936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790786.287996:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056192 00000100:00100000:1.0:1787790786.288001:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056192 00010000:00010000:1.0:1787790786.288018:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 21 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.288041:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787790786.288048:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+21:3640:x1874634268056192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790786.288055:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790786.288059:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 21 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.288076:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 21 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.288088:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994e00/0xcf9477fddcf1db2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1db23 expref: 21 pid: 6507 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.288097:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790786.288163:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75db525-924f-489b-b982-1d04f64567fb+20:3640:x1874634268056192:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.288170:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790786.288214:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268056192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790786.298984:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055552:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790786.299003:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1874634268055680:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790786.299047:0:13722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790786.301206:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790786.301248:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790786.301626:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151552 00000100:00100000:1.0:1787790786.301635:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151552 00010000:00010000:1.0:1787790786.301675:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 13 pid: 6506 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790786.301737:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151424 00000100:00100000:1.0:1787790786.301741:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151424 00000100:00100000:2.0:1787790786.301747:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00010000:00010000:1.0:1787790786.301754:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 14 pid: 6507 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.301758:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+14:2402:x1874634250151552:12345-192.168.202.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787790786.301782:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:1.0:1787790786.301789:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56437f26-ebd6-4232-a9cd-72d1b9652a36+14:2402:x1874634250151424:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790786.301796:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790786.301796:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790786.301802:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 14 pid: 6506 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.301802:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 14 pid: 6507 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.301813:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 14 pid: 6506 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302431:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 14 pid: 6507 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.302462:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030200/0xcf9477fddcf1db15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b19 expref: 14 pid: 6506 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302464:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1db1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b20 expref: 14 pid: 6507 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302481:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302489:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790786.302497:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790786.302507:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302514:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302520:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302526:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302531:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790786.302535:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.302543:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790786.302566:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:2402:x1874634250151552:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 801us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790786.302954:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00010000:00010000:0.0:1787790786.303568:0:13722:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790786.303996:0:13722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.304791:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.304818:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e000/0xcf9477fddcf1dc88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790786.304840:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790786.305246:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:2402:x1874634250151424:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 3451us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790786.305259:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00010000:00010000:1.0:1787790786.379104:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787790787.371580:0:13772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff02efd130 20000000:00000080:1.0:1787790787.371598:0:13772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff916fc3737800 uarg=0000000000000000 20000000:01000000:1.0:1787790787.371689:0:13772:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787790787.371696:0:13772:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787790787.371702:0:13772:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787790787.382990:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787790787.383195:0:13772:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787790787.383331:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787790787.383363:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787790787.383382:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787790787.383396:0:13772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790787.383415:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383432:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383442:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383449:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383475:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383483:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383489:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790787.383493:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383501:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383514:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383522:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.383528:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dc96 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790787.404535:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790787.406556:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790787.406594:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268056320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790787.406643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790787.406741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151680 00000100:00100000:0.0:1787790787.406750:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151680 00000100:00100000:0.0:1787790787.406798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 334 00000100:00100000:0.0:1787790787.406807:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:6170:x1874634250151680:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790787.406825:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790787.406847:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1dc9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b6d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790787.406876:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1dc9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b6d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790787.406888:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1dc9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b6d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790787.406897:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5c00, rc 0) 00000100:00100000:0.0:1787790787.406941:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250151680:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 135us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790787.406948:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 334 00000100:00100000:0.0:1787790787.407117:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268056448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790787.407144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790787.407176:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056320 00000100:00100000:0.0:1787790787.407181:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056320 00000100:00100000:0.0:1787790787.407211:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056448 00000100:00100000:0.0:1787790787.407224:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056448 00000100:00100000:0.0:1787790787.407241:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787790787.407247:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268056320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790787.407280:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790787.408193:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268056320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 941us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790787.408205:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787790787.408228:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787790787.408237:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268056448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790787.408252:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790787.408288:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268056448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790787.408303:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1787790787.408409:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bc3c0 x1874634268056320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790787.408430:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268056320:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787790787.408527:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790787.408556:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bde00 x1874634268056448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790787.408569:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268056448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790787.416231:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790787.416342:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151808 00000100:00100000:1.0:1787790787.416352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151808 00000100:00100000:1.0:1787790787.416416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 335 00000100:00100000:1.0:1787790787.416427:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250151808:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790787.416566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250151808:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.416573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 335 00000100:00100000:3.0:1787790787.424066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790787.424104:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250151936 00000100:00100000:3.0:1787790787.424113:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250151936 00000100:00100000:3.0:1787790787.424163:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 336 00000100:00100000:3.0:1787790787.424173:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250151936:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.424309:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250151936:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 137us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.424337:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 336 00000100:00100000:1.0:1787790787.428084:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790787.428257:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152064 00000100:00100000:3.0:1787790787.428268:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152064 00000100:00100000:3.0:1787790787.428383:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 337 00000100:00100000:3.0:1787790787.428393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:10776:x1874634250152064:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790787.428560:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:10776:x1874634250152064:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 166us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.428568:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 337 00000100:00100000:0.0:1787790787.443700:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790787.443815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152192 00000100:00100000:1.0:1787790787.443825:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152192 00000100:00100000:1.0:1787790787.443881:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 338 00000100:00100000:1.0:1787790787.443892:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:10776:x1874634250152192:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790787.444048:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:10776:x1874634250152192:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 158us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.444057:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 338 00000100:00100000:0.0:1787790787.452007:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790787.452125:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152320 00000100:00100000:1.0:1787790787.452138:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152320 00000100:00100000:1.0:1787790787.452190:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 339 00000100:00100000:1.0:1787790787.452200:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:6170:x1874634250152320:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790787.452218:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790787.452239:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1dca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.452271:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1dca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b74 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.452284:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1dca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b74 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790787.452294:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbc00, rc 0) 00000100:00100000:1.0:1787790787.452364:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250152320:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.452372:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 339 00000100:00100000:0.0:1787790787.464510:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790787.464593:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152448 00000100:00100000:1.0:1787790787.464604:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152448 00000100:00100000:1.0:1787790787.464683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 340 00000100:00100000:1.0:1787790787.464693:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250152448:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790787.464904:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250152448:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 210us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790787.464911:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 340 00000100:00100000:1.0:1787790787.475811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790787.475957:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152576 00000100:00100000:0.0:1787790787.475968:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152576 00000100:00100000:0.0:1787790787.476034:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 341 00000100:00100000:0.0:1787790787.476044:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250152576:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790787.476316:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:6170:x1874634250152576:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 272us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790787.476334:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 341 00000100:00100000:1.0:1787790787.485478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790787.485602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152704 00000100:00100000:2.0:1787790787.485614:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152704 00000100:00100000:2.0:1787790787.485691:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 342 00000100:00100000:2.0:1787790787.485703:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:10780:x1874634250152704:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790787.486263:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:10780:x1874634250152704:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 560us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.486283:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 342 00000100:00100000:0.0:1787790787.497765:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790787.497846:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152832 00000100:00100000:3.0:1787790787.497857:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152832 00000100:00100000:3.0:1787790787.497907:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 343 00000100:00100000:3.0:1787790787.497917:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:10780:x1874634250152832:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790787.498073:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:10780:x1874634250152832:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 157us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.498082:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 343 10000000:01000000:2.0:1787790787.532179:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790787.532185:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f67a4800 from 7 10000000:01000000:2.0:1787790787.532189:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790787.532229:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790787.532237:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790787.532245:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790787.532265:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268056576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790787.532327:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790787.532374:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37e69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.532410:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056576 00000100:00100000:3.0:1787790787.532417:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056576 00000100:00100000:3.0:1787790787.532469:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787790787.532480:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+20:6509:x1874634268056576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790787.532493:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790787.532505:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dcb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dcab expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.532527:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dcb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcab expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.532569:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dcb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcab expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.532585:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e200, rc 0) 00000100:00100000:3.0:1787790787.532638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268056576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.532645:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787790787.532753:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268056576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790787.532769:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790787.532779:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790787.532838:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268056704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790787.532878:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790787.532907:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.532948:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056704 00000100:00100000:3.0:1787790787.532952:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056704 00000100:00100000:3.0:1787790787.533022:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787790787.533030:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268056704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.533135:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268056704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.533142:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787790787.533213:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268056704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790787.533243:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268056832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790787.533283:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790787.533416:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.533863:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056832 00000100:00100000:3.0:1787790787.533868:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056832 00000100:00100000:3.0:1787790787.533895:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787790787.533903:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268056832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.533994:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268056832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.534001:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787790787.534042:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268056832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.534230:0:13782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13782:1874634268056960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.534267:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.534313:0:13782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c12ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790787.534455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268056960 00000100:00100000:2.0:1787790787.534460:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268056960 00000100:00100000:2.0:1787790787.534485:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787790787.534493:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:13782:x1874634268056960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790787.534629:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+21:13782:x1874634268056960:12345-0@lo:502:llog_process_th.0 Request processed in 136us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.534636:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787790787.536153:0:13782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13782:1874634268056960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790787.536196:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790787.536207:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.536209:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790787.536216:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f67a4800 00000020:00000080:3.0:1787790787.536219:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790787.536339:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790787.536344:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.536350:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790787.536353:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790787.536356:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.536357:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787790787.536361:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f67a4800 00000020:00000080:3.0:1787790787.536363:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787790787.540283:0:13782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13782:1874634268057088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.540381:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.540421:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057088 00000100:00100000:3.0:1787790787.540428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057088 00000100:00100000:3.0:1787790787.540475:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787790787.540483:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:13782:x1874634268057088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.540590:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+21:13782:x1874634268057088:12345-0@lo:502:llog_process_th.0 Request processed in 106us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.540598:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787790787.540645:0:13782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c12ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.540677:0:13782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13782:1874634268057088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790787.540738:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790787.540746:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.540755:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787790787.540760:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787790787.540831:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787790787.540854:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790787.540864:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.540876:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790787.540886:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790787.540889:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3c78800 from 7 10000000:01000000:3.0:1787790787.540892:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790787.540915:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.540923:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.540931:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.540943:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.540970:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.540984:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c12ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.540997:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057216 00000100:00100000:3.0:1787790787.541001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057216 00000100:00100000:3.0:1787790787.541021:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787790787.541028:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+21:6509:x1874634268057216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790787.541036:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790787.541053:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1dcc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dcb9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.541073:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1dcc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcb9 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.541084:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1dcc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcb9 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.541093:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f000, rc 0) 00000100:00100000:3.0:1787790787.541121:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268057216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.541127:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787790787.541158:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790787.541170:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.541179:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.541221:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.541242:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.541254:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c12ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.541264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057344 00000100:00100000:3.0:1787790787.541266:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057344 00000100:00100000:3.0:1787790787.541284:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787790787.541289:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268057344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.541369:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268057344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.541380:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787790787.541407:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.541429:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.541458:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.541469:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c12ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.541478:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057472 00000100:00100000:3.0:1787790787.541481:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057472 00000100:00100000:3.0:1787790787.541497:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787790787.541502:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268057472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.541561:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268057472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.541568:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787790787.541603:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.545371:0:13784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13784:1874634268057600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.545458:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.545501:0:13784:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790787.546435:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057600 00000100:00100000:2.0:1787790787.546445:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057600 00000100:00100000:2.0:1787790787.546499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787790787.546508:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:13784:x1874634268057600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790787.546647:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:13784:x1874634268057600:12345-0@lo:502:llog_process_th.0 Request processed in 139us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.546662:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787790787.546759:0:13784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26be1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13784:1874634268057600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790787.546793:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790787.546803:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790787.546806:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787790787.546812:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f3c78800 00000020:00000080:2.0:1787790787.546814:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787790787.546880:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790787.546884:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790787.546885:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787790787.546888:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790787.546890:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790787.546892:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787790787.546895:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f3c78800 00000020:00000080:2.0:1787790787.546897:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787790787.546939:0:13784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13784:1874634268057728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790787.546980:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790787.547006:0:13784:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.547459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057728 00000100:00100000:3.0:1787790787.547464:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057728 00000100:00100000:3.0:1787790787.547505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787790787.547513:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:13784:x1874634268057728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.551263:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+22:13784:x1874634268057728:12345-0@lo:502:llog_process_th.0 Request processed in 3741us (4273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.551278:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787790787.552470:0:13784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13784:1874634268057728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790787.552513:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790787.552520:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790787.552522:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787790787.552526:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787790787.553373:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787790787.553423:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790787.553435:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.553446:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790787.553463:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790787.553466:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f3e20800 from 7 10000000:01000000:3.0:1787790787.553469:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790787.553516:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.553525:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.553535:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.553573:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.553657:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.553736:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790787.555457:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057856 00000100:00100000:2.0:1787790787.555471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057856 00000100:00100000:2.0:1787790787.555529:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787790787.555540:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+22:6509:x1874634268057856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790787.555556:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790787.555581:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1dcce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dcc7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790787.555611:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1dcce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcc7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790787.555621:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1dcce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcc7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790787.555629:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995400, rc 0) 00000100:00100000:2.0:1787790787.555719:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268057856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.555727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787790787.556384:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790787.556405:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.556416:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.556492:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.556540:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.556589:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790787.557537:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268057984 00000100:00100000:2.0:1787790787.557546:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268057984 00000100:00100000:2.0:1787790787.557593:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787790787.557602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268057984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790787.557780:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268057984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.557787:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787790787.558094:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268057984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.558138:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.558181:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.558214:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790787.558256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058112 00000100:00100000:2.0:1787790787.558261:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058112 00000100:00100000:2.0:1787790787.558290:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787790787.558297:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268058112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790787.558380:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268058112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.558387:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787790787.563641:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.563916:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13787:1874634268058240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.563985:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.564017:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790787.564442:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058240 00000100:00100000:2.0:1787790787.564456:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058240 00000100:00100000:2.0:1787790787.564512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787790787.564521:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:13787:x1874634268058240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790787.564651:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+23:13787:x1874634268058240:12345-0@lo:502:llog_process_th.0 Request processed in 130us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790787.564658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787790787.568091:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13787:1874634268058240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790787.568139:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790787.568150:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.568153:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790787.568162:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f3e20800 00000020:00000080:3.0:1787790787.568165:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790787.568222:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790787.568489:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.568492:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790787.568496:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790787.568500:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.568501:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787790787.568505:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f3e20800 00000020:00000080:3.0:1787790787.568507:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787790787.568754:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13787:1874634268058368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.568827:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.568873:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058368 00000100:00100000:3.0:1787790787.568879:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058368 00000100:00100000:3.0:1787790787.568923:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787790787.568932:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:13787:x1874634268058368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.569036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+23:13787:x1874634268058368:12345-0@lo:502:llog_process_th.0 Request processed in 105us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.569044:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787790787.569090:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.569105:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13787:1874634268058368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790787.569124:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790787.569129:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790787.569131:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787790787.569134:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787790787.569198:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787790787.569218:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790787.569227:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569238:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790787.569248:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790787.569250:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c2ab0800 from 7 10000000:01000000:3.0:1787790787.569254:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790787.569276:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569283:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569302:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.569315:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.569341:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.569356:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.569370:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058496 00000100:00100000:3.0:1787790787.569373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058496 00000100:00100000:3.0:1787790787.569394:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787790787.569400:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+23:6509:x1874634268058496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790787.569409:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790787.569421:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1dcdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1dcd5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569444:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1dcdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcd5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569455:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1dcdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1dcd5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569463:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fe00, rc 0) 00000100:00100000:3.0:1787790787.569490:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268058496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.569496:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787790787.569525:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790787.569537:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.569551:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790787.569596:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.569621:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.569634:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.569645:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058624 00000100:00100000:3.0:1787790787.569648:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058624 00000100:00100000:3.0:1787790787.569683:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787790787.569690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268058624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.569791:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268058624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.569797:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787790787.569821:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.569845:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.569877:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790787.569895:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.569905:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058752 00000100:00100000:3.0:1787790787.569908:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058752 00000100:00100000:3.0:1787790787.569932:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787790787.569937:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268058752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790787.570000:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:6509:x1874634268058752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.570006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787790787.570044:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a75db525-924f-489b-b982-1d04f64567fb:6509:1874634268058752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787790787.571596:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe66d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13790:1874634268058880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790787.571656:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790787.571720:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a480 going to sleep for 11 seconds 00000040:00080000:2.0:1787790787.573061:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787790787.574520:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268058880 00000100:00100000:3.0:1787790787.574536:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268058880 00000100:00100000:3.0:1787790787.574585:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787790787.574594:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:13790:x1874634268058880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.574846:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:13790:x1874634268058880:12345-0@lo:502:llog_process_th.0 Request processed in 253us (3189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.574854:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787790787.585054:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe66d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13790:1874634268058880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787790787.585183:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790787.585197:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790787.585200:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787790787.585209:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170c2ab0800 00000020:00000080:1.0:1787790787.585212:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787790787.585264:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790787.585267:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790787.585268:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787790787.585271:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790787.585274:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790787.585275:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787790787.585278:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170c2ab0800 00000020:00000080:1.0:1787790787.585279:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787790787.585329:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe66d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13790:1874634268059008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790787.585415:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790787.585453:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787790787.587416:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059008 00000100:00100000:3.0:1787790787.587427:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059008 00000100:00100000:3.0:1787790787.587478:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787790787.587487:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:13790:x1874634268059008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790787.587636:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:13790:x1874634268059008:12345-0@lo:502:llog_process_th.0 Request processed in 149us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790787.587643:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787790787.592791:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe66d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a75db525-924f-489b-b982-1d04f64567fb:13790:1874634268059008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787790787.592856:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790787.592864:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790787.592866:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787790787.592872:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787790787.592959:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787790787.592992:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790787.593003:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790787.593015:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790787.638092:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790788.426977:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790788.429875:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790788.429941:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268059136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790788.430019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790788.430080:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059136 00000100:00100000:0.0:1787790788.430101:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059136 00000100:00100000:0.0:1787790788.430159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787790788.430169:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268059136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790788.430206:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787790788.430269:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268059136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790788.430276:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787790788.430759:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268059136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790788.431822:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790788.431853:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268059264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790788.431917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790788.432102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059264 00000100:00100000:3.0:1787790788.432122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059264 00000100:00100000:3.0:1787790788.432176:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787790788.432185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268059264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787790788.432214:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787790788.432332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268059264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790788.432340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787790788.434099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268059264:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787790788.619188:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787790788.683624:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790789.455216:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790789.963011:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790789.963049:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268059392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790789.963127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790789.963369:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059392 00000100:00100000:2.0:1787790789.963378:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059392 00000100:00100000:2.0:1787790789.963450:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787790789.963461:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268059392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790789.963492:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790789.963543:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268059392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.963550:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787790789.964254:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790789.964302:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268059392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790789.965947:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268059520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790789.966035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790789.966413:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059520 00000100:00100000:1.0:1787790789.966420:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059520 00000100:00100000:1.0:1787790789.966488:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787790789.966498:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268059520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790789.966519:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790789.966579:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268059520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790789.966598:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787790789.966861:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790789.966901:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268059520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790789.967253:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268059904:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.967292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.967325:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268060416:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.967349:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.967365:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268060928:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.967381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.967396:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787790789.967401:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268059776:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.967453:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.967468:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268060288:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.967486:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.967500:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268060800:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.967520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.967545:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060416 00000100:00100000:3.0:1787790789.967564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060416 00000100:00100000:3.0:1787790789.968132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060928 00000100:00100000:3.0:1787790789.968137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060928 00000100:00100000:3.0:1787790789.968151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059776 00000100:00100000:3.0:1787790789.968153:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059776 00000100:00100000:3.0:1787790789.968162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060288 00000100:00100000:3.0:1787790789.968164:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060288 00000100:00100000:3.0:1787790789.968174:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060800 00000100:00100000:3.0:1787790789.968176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060800 00000100:00100000:3.0:1787790789.968189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787790789.968196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268060416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.968245:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268060416:12345-0@lo:400:kworker.0 Request processed in 49us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790789.968251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787790789.968264:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787790789.968270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268060928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.968290:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268060928:12345-0@lo:400:kworker.0 Request processed in 21us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790789.968296:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787790789.968304:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787790789.968308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268059776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.968330:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268059776:12345-0@lo:400:kworker.0 Request processed in 21us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790789.968335:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787790789.968345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787790789.968351:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268060288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.968376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268060288:12345-0@lo:400:kworker.0 Request processed in 25us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790789.968395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787790789.968407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787790789.968413:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268060800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.968441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268060800:12345-0@lo:400:kworker.0 Request processed in 29us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790789.968447:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1787790789.968482:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790789.968486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790789.968511:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268060032:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.968542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.968578:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268060544:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.968737:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268059648:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.968772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790789.968801:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268060160:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.968824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790789.968841:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268060672:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.968863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790789.968894:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059648 00000100:00100000:2.0:1787790789.968898:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059648 00000100:00100000:2.0:1787790789.968923:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787790789.968936:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268059648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.968966:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268059648:12345-0@lo:400:kworker.0 Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.968972:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787790789.969007:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060672 00000100:00100000:2.0:1787790789.969010:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060672 00000100:00100000:2.0:1787790789.969044:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787790789.969050:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268060672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969075:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268060672:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.969080:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787790789.969091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790789.969109:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268059648:0@lo:400:kworker.0 00010000:00080000:2.0:1787790789.969120:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e5a40 x1874634268060672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790789.969131:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268060672:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969148:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060160 00000100:00100000:2.0:1787790789.969151:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060160 00000100:00100000:2.0:1787790789.969168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787790789.969173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268060160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969198:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268060160:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.969204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787790789.969223:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268060160:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969251:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268059904 00000100:00100000:2.0:1787790789.969259:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268059904 00000100:00100000:2.0:1787790789.969277:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060032 00000100:00100000:2.0:1787790789.969279:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060032 00000100:00100000:2.0:1787790789.969289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787790789.969293:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268059904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268059904:12345-0@lo:400:kworker.0 Request processed in 30us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.969329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787790789.969339:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790789.969344:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268060032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969368:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268060032:12345-0@lo:400:kworker.0 Request processed in 25us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790789.969374:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790789.969399:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268059776:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969409:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268060288:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268060800:0@lo:400:kworker.0 00000100:00100000:2.0:1787790789.969429:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268059904:0@lo:400:kworker.0 00010000:00080000:2.0:1787790789.969439:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e4780 x1874634268060416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790789.969448:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268060416:0@lo:400:kworker.0 00010000:00080000:2.0:1787790789.969457:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e5680 x1874634268060928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790789.969465:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268060928:0@lo:400:kworker.0 00000100:00100000:3.0:1787790789.970483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790789.970544:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268060032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790789.971128:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268060544 00000100:00100000:0.0:1787790789.971135:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268060544 00000100:00100000:0.0:1787790789.971197:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787790789.971206:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268060544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790789.971246:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268060544:12345-0@lo:400:kworker.0 Request processed in 43us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790789.971251:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1787790789.971631:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e43c0 x1874634268060544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790789.971643:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268060544:0@lo:400:kworker.0 00000100:00080000:1.0:1787790789.973774:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790790.474880:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790791.115429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790791.115488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790791.115537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790791.115617:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790791.115680:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250152960 00000100:00100000:3.0:1787790791.115693:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250152960 00000100:00100000:3.0:1787790791.115767:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 365 00000100:00100000:3.0:1787790791.115778:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250152960:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790791.115862:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250152960:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 86us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790791.115870:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 365 00000100:00100000:1.0:1787790791.121335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790791.121395:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790791.126071:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153216 00000100:00100000:2.0:1787790791.126088:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153216 00000100:00100000:2.0:1787790791.126193:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153472 00000100:00100000:2.0:1787790791.126197:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153472 00000100:00100000:2.0:1787790791.126216:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153088 00000100:00100000:2.0:1787790791.126219:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153088 00000100:00100000:2.0:1787790791.126245:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 205 00000100:00100000:2.0:1787790791.126254:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250153216:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790791.126345:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250153216:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 92us (10856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790791.126354:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 205 00000100:00100000:2.0:1787790791.126372:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 206 00000100:00100000:2.0:1787790791.126378:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250153472:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790791.126403:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250153472:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (10864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790791.126408:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 206 00000100:00100000:2.0:1787790791.126420:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 207 00000100:00100000:2.0:1787790791.126426:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250153088:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790791.126448:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250153088:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (10832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790791.126453:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 207 00000100:00100000:2.0:1787790791.127209:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153344 00000100:00100000:2.0:1787790791.127216:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153344 00000100:00100000:2.0:1787790791.127252:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:2.0:1787790791.127259:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250153344:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790791.127321:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250153344:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 62us (5996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790791.127328:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00080000:2.0:1787790791.127347:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790791.127351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790791.127354:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790791.130934:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153600 00000100:00100000:2.0:1787790791.130959:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153600 00000100:00100000:2.0:1787790791.131046:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 208 00000100:00100000:2.0:1787790791.131056:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250153600:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790791.131131:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250153600:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 77us (9736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790791.131140:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 208 00000100:00080000:1.0:1787790791.131311:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787790791.499897:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787790792.021797:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1787790792.523458:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268061056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790792.523567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790792.523757:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268061184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787790792.523899:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790792.526387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790792.548747:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061056 00000100:00100000:0.0:1787790792.548776:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061056 00000100:00100000:0.0:1787790792.548892:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061184 00000100:00100000:0.0:1787790792.548897:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061184 00000100:00100000:0.0:1787790792.548920:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787790792.548930:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268061056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790792.548968:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790792.549069:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268061056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (25502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790792.549077:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787790792.549229:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787790792.549240:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268061184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790792.549252:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790792.549304:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268061184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (22926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790792.549310:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787790792.549354:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f2d00 x1874634268061184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790792.549386:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268061184:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787790792.549423:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e4000 x1874634268061056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790792.549436:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268061056:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787790792.549753:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787790793.547085:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790793.548430:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790793.548458:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268061312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790793.548543:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790793.549106:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061312 00000100:00100000:2.0:1787790793.549116:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061312 00000100:00100000:2.0:1787790793.549172:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787790793.549182:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268061312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790793.549218:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790793.549399:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268061312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790793.549505:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268061312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790793.549513:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787790793.550195:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268061440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790793.550360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790793.550568:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061440 00000100:00100000:3.0:1787790793.550574:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061440 00000100:00100000:3.0:1787790793.550623:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787790793.550631:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268061440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790793.550661:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787790793.550754:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268061440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790793.550972:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787790793.551662:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268061440:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787790794.571539:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790795.083412:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790795.083448:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268061568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790795.083518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.083741:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061568 00000100:00100000:1.0:1787790795.083761:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061568 00000100:00100000:1.0:1787790795.083869:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787790795.083879:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268061568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790795.083918:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790795.083996:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268061568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790795.084002:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787790795.084442:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268061568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790795.084925:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790795.084953:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268061696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790795.085006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790795.085365:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061696 00000100:00100000:0.0:1787790795.085372:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061696 00000100:00100000:3.0:1787790795.085506:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268062080:0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.085534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790795.085560:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268062592:0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.085583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790795.085615:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268063104:0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.085653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790795.085674:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790795.085680:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268062208:0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.085700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790795.085739:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268062720:0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.085775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790795.085801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062080 00000100:00100000:3.0:1787790795.085805:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062080 00000100:00100000:3.0:1787790795.085850:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062208 00000100:00100000:3.0:1787790795.085853:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062208 00000100:00100000:3.0:1787790795.085868:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787790795.085875:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268062080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.085933:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268062080:12345-0@lo:400:kworker.0 Request processed in 58us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790795.085953:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787790795.085968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787790795.085974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268062208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.086138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268062208:12345-0@lo:400:kworker.0 Request processed in 164us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790795.086144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787790795.086162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062592 00000100:00100000:3.0:1787790795.086166:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062592 00000100:00100000:1.0:1787790795.087855:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268061952:0@lo:400:kworker.0 00000100:00100000:1.0:1787790795.087929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.087986:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268062464:0@lo:400:kworker.0 00000100:00100000:1.0:1787790795.088005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.088023:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268062976:0@lo:400:kworker.0 00000100:00100000:1.0:1787790795.088537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.088569:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787790795.088576:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268061824:0@lo:400:kworker.0 00000100:00100000:1.0:1787790795.088620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.088654:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268062336:0@lo:400:kworker.0 00000100:00100000:1.0:1787790795.088676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.088688:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268062848:0@lo:400:kworker.0 00000100:00100000:1.0:1787790795.088762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790795.088798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063104 00000100:00100000:1.0:1787790795.088805:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063104 00000100:00080000:2.0:1787790795.088992:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790795.089006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061952 00000100:00100000:2.0:1787790795.089010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061952 00000100:00100000:2.0:1787790795.089056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062464 00000100:00100000:2.0:1787790795.089059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062464 00000100:00100000:2.0:1787790795.089073:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062976 00000100:00100000:2.0:1787790795.089076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062976 00000100:00100000:2.0:1787790795.089087:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062336 00000100:00100000:2.0:1787790795.089090:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062336 00000100:00100000:2.0:1787790795.089102:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787790795.089110:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268061952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089167:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268061952:12345-0@lo:400:kworker.0 Request processed in 57us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787790795.089190:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787790795.089196:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268062464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089224:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268062464:12345-0@lo:400:kworker.0 Request processed in 28us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089229:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787790795.089239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787790795.089245:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268062976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089283:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268062976:12345-0@lo:400:kworker.0 Request processed in 38us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089289:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787790795.089300:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787790795.089305:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268062336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268062336:12345-0@lo:400:kworker.0 Request processed in 34us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089345:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787790795.089369:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268061824 00000100:00100000:2.0:1787790795.089372:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268061824 00000100:00100000:2.0:1787790795.089425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787790795.089432:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268061824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089460:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268061824:12345-0@lo:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:2.0:1787790795.089487:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790795.089491:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790795.089551:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268062208:0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089565:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268062080:0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089623:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062720 00000100:00100000:2.0:1787790795.089627:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062720 00000100:00100000:2.0:1787790795.089656:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268062848 00000100:00100000:2.0:1787790795.089660:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268062848 00000100:00100000:2.0:1787790795.089679:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787790795.089685:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268062720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089739:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268062720:12345-0@lo:400:kworker.0 Request processed in 54us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089757:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787790795.089769:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787790795.089775:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268062848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089804:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268062848:12345-0@lo:400:kworker.0 Request processed in 29us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790795.089816:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1787790795.089865:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f21c0 x1874634268062720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790795.089877:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268062720:0@lo:400:kworker.0 00000100:00080000:2.0:1787790795.089892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790795.089928:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268061824:0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089939:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268062336:0@lo:400:kworker.0 00010000:00080000:2.0:1787790795.089949:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f30c0 x1874634268062848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790795.089958:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268062848:0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089969:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268061952:0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089979:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268062464:0@lo:400:kworker.0 00000100:00100000:2.0:1787790795.089988:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268062976:0@lo:400:kworker.0 00000100:00100000:0.0:1787790795.092810:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787790795.092836:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268061696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790795.092865:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790795.098207:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268061696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5375us (13190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790795.098222:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787790795.098370:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787790795.098377:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170fbe670c0, transno 4294967301 00000100:00100000:0.0:1787790795.098404:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268061696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790795.099947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787790795.099963:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268062592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790795.100074:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268062592:12345-0@lo:400:kworker.0 Request processed in 117us (14489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790795.100081:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00080000:3.0:1787790795.100129:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f0000 x1874634268062592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790795.100142:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268062592:0@lo:400:kworker.0 00000100:00100000:0.0:1787790795.103110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787790795.103131:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268063104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790795.103226:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268063104:12345-0@lo:400:kworker.0 Request processed in 102us (17571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790795.103233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00080000:1.0:1787790795.103437:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f2940 x1874634268063104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790795.103473:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268063104:0@lo:400:kworker.0 00010000:00010000:1.0:1787790795.595821:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790796.234225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790796.234271:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790796.234317:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790796.234355:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790796.234377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790796.234399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790796.234424:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154112 00000100:00100000:2.0:1787790796.234433:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154112 00000100:00100000:2.0:1787790796.234533:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:2.0:1787790796.234543:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250154112:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790796.234649:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250154112:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 107us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790796.234657:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00080000:2.0:1787790796.234693:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790796.235038:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153984 00000100:00100000:1.0:1787790796.235043:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153984 00000100:00100000:1.0:1787790796.235071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154240 00000100:00100000:1.0:1787790796.235074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154240 00000100:00100000:1.0:1787790796.235086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153856 00000100:00100000:1.0:1787790796.235089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153856 00000100:00100000:1.0:1787790796.235100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154368 00000100:00100000:1.0:1787790796.235103:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154368 00000100:00100000:1.0:1787790796.235118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 215 00000100:00100000:1.0:1787790796.235125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250153984:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790796.235161:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250153984:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 37us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790796.235168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 215 00000100:00100000:1.0:1787790796.235181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 216 00000100:00100000:1.0:1787790796.235186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250154240:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790796.235212:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250154240:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790796.235219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 216 00000100:00100000:1.0:1787790796.235229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 217 00000100:00100000:1.0:1787790796.235234:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250153856:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790796.235255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250153856:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 21us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790796.235261:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 217 00000100:00100000:1.0:1787790796.235280:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 218 00000100:00100000:1.0:1787790796.235286:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250154368:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790796.235309:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250154368:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790796.235315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 218 00000100:00080000:2.0:1787790796.235607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790796.235611:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790796.235760:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250153728 00000100:00100000:3.0:1787790796.235766:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250153728 00000100:00100000:3.0:1787790796.235802:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 367 00000100:00100000:3.0:1787790796.235808:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250153728:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790796.235859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250153728:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 51us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790796.235865:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 367 00010000:00010000:2.0:1787790796.618845:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790797.643336:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790797.643357:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268063232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790797.643416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790797.643548:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268063360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790797.643601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790797.644445:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063232 00000100:00100000:0.0:1787790797.644452:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063232 00000100:00100000:0.0:1787790797.644501:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063360 00000100:00100000:0.0:1787790797.644504:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063360 00000100:00100000:0.0:1787790797.644524:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787790797.644533:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268063232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790797.644563:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790797.644658:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268063232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790797.644665:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787790797.644681:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787790797.644685:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268063360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790797.644692:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790797.644734:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268063360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790797.644739:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1787790797.644843:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbdca580 x1874634268063232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790797.644859:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268063232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790797.645364:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1787790797.645608:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e7840 x1874634268063360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790797.645634:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268063360:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787790797.645667:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790798.667037:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268063488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790798.667113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790798.667149:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790798.667162:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268063616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790798.667189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790798.667287:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790798.667535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063488 00000100:00100000:1.0:1787790798.667543:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063488 00000100:00100000:1.0:1787790798.667601:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063616 00000100:00100000:1.0:1787790798.667604:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063616 00000100:00100000:1.0:1787790798.667618:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787790798.667624:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268063488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790798.667660:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790798.667702:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268063488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790798.667743:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268063488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790798.667744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787790798.667761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787790798.667767:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268063616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790798.667783:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790798.667820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268063616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790798.667837:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268063616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790798.667851:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000040:00080000:1.0:1787790798.859205:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787790798.927650:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787790799.691070:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790800.203356:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790800.203380:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268063872:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.203463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790800.203482:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268063744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790800.203514:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063872 00000100:00100000:3.0:1787790800.203523:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063872 00000100:00100000:2.0:1787790800.203547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.203564:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268064000:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.203590:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787790800.203602:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268063872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790800.203617:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268063744 00000100:00100000:2.0:1787790800.203625:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268063744 00000100:00100000:2.0:1787790800.203753:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787790800.203939:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268063744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787790800.203992:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790800.205058:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268064128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790800.208922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.209015:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064000 00000100:00100000:1.0:1787790800.209024:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064000 00000100:00100000:1.0:1787790800.209078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787790800.209087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268064000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.209142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268064000:12345-0@lo:400:kworker.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.209149:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787790800.209211:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268064000:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.209272:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790800.209281:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268064384:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.209314:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.209361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268064512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.209373:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268063872:12345-0@lo:400:kworker.0 Request processed in 5771us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.209385:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787790800.209391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.209424:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268063872:0@lo:400:kworker.0 00000100:00080000:3.0:1787790800.209433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790800.209463:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064512 00000100:00100000:1.0:1787790800.209467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064512 00000100:00100000:3.0:1787790800.209480:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268064256:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.209497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787790800.209511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.209525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268064512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.209594:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268064512:12345-0@lo:400:kworker.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.209979:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064384 00000100:00100000:3.0:1787790800.209984:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064384 00000100:00100000:3.0:1787790800.210012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064256 00000100:00100000:3.0:1787790800.210015:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064256 00000100:00100000:3.0:1787790800.210029:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787790800.210036:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268064384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268064384:12345-0@lo:400:kworker.0 Request processed in 38us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.210080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787790800.210091:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790800.210097:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268064256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210124:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268064256:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.210142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790800.210168:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268064256:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210234:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790800.210241:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268064640:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790800.210287:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064640 00000100:00100000:3.0:1787790800.210290:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064640 00000100:00100000:3.0:1787790800.210319:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787790800.210325:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268064640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210356:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268064640:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.210363:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787790800.210376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1787790800.210377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790800.210396:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268064640:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210434:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268064768:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.210445:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268064512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.210467:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268064384:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.210497:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064768 00000100:00100000:1.0:1787790800.210502:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064768 00000100:00100000:3.0:1787790800.210507:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268064896:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.210543:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787790800.210551:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268064768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210605:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790800.210613:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268065024:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.210616:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268064768:12345-0@lo:400:kworker.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.210625:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787790800.210642:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787790800.210645:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787790800.210675:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbdc8f00 x1874634268064768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790800.210689:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268064768:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210726:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268065408:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.210738:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268065280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.210777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.210805:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790800.210806:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064896 00000100:00100000:1.0:1787790800.210812:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268065152:0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210819:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064896 00000100:00100000:1.0:1787790800.210842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790800.210855:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065024 00000100:00100000:3.0:1787790800.210859:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065024 00000100:00080000:1.0:1787790800.210872:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790800.210876:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065408 00000100:00100000:3.0:1787790800.210879:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065408 00000100:00100000:1.0:1787790800.210884:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065280 00000100:00100000:1.0:1787790800.210889:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065280 00000100:00100000:3.0:1787790800.210901:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790800.210910:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268064896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.210927:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065152 00000100:00100000:3.0:1787790800.210946:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268064896:12345-0@lo:400:kworker.0 Request processed in 39us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.210952:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790800.210963:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787790800.210969:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268065024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.210995:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268065024:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.211001:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787790800.211010:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787790800.211016:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268065408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.211036:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268065408:12345-0@lo:400:kworker.0 Request processed in 20us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.211041:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787790800.211064:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268065408:0@lo:400:kworker.0 00010000:00080000:3.0:1787790800.211073:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbdc8780 x1874634268065024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790800.211082:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268065024:0@lo:400:kworker.0 00010000:00080000:3.0:1787790800.211090:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbdc9e00 x1874634268064896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790800.211108:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268064896:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.211145:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065152 00000100:00100000:1.0:1787790800.211185:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787790800.211192:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268065280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.211204:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787790800.211214:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268065152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790800.211249:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268065152:12345-0@lo:400:kworker.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790800.211255:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787790800.212094:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268065280:12345-0@lo:400:kworker.0 Request processed in 899us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.212105:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1787790800.212128:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790800.212132:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790800.212135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790800.212166:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268063744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8245us (8621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790800.212176:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787790800.212679:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268065152:0@lo:400:kworker.0 00010000:00080000:1.0:1787790800.212702:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbdc9680 x1874634268065280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790800.212794:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268065280:0@lo:400:kworker.0 00000100:00100000:1.0:1787790800.212817:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268063744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790800.214100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790800.214304:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268064128 00000100:00100000:1.0:1787790800.214312:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268064128 00000100:00100000:1.0:1787790800.214419:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787790800.214432:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268064128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790800.214458:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790800.214508:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268064128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790800.214516:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787790800.214602:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268064128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787790800.714969:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790801.350638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790801.350739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790801.350806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790801.350934:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154752 00000100:00100000:0.0:1787790801.350953:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154752 00000100:00100000:0.0:1787790801.351025:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154624 00000100:00100000:0.0:1787790801.351028:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154624 00000100:00100000:0.0:1787790801.351052:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 225 00000100:00100000:0.0:1787790801.351062:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250154752:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790801.351160:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250154752:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 99us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790801.351177:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 225 00000100:00100000:0.0:1787790801.351195:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 226 00000100:00100000:0.0:1787790801.351202:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250154624:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790801.351229:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250154624:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790801.351235:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 226 00000100:00080000:1.0:1787790801.351517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790801.351521:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790801.351739:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154496 00000100:00100000:2.0:1787790801.351745:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154496 00000100:00100000:2.0:1787790801.351786:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 369 00000100:00100000:2.0:1787790801.351794:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250154496:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790801.351838:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250154496:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 45us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790801.351853:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 369 00000100:00100000:1.0:1787790801.363410:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790801.363453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790801.363557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790801.363651:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155008 00000100:00100000:0.0:1787790801.363662:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155008 00000100:00100000:0.0:1787790801.363764:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155136 00000100:00100000:0.0:1787790801.363768:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155136 00000100:00100000:0.0:1787790801.363803:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 227 00000100:00100000:0.0:1787790801.363813:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250155008:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790801.363886:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250155008:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790801.363894:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 227 00000100:00100000:0.0:1787790801.363911:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 228 00000100:00100000:0.0:1787790801.363917:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250155136:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790801.363948:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250155136:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790801.363954:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 228 00000100:00080000:1.0:1787790801.364381:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790801.364387:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790801.364529:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250154880 00000100:00100000:3.0:1787790801.364535:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250154880 00000100:00100000:3.0:1787790801.364604:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:3.0:1787790801.364613:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2399:x1874634250154880:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:3.0:1787790801.364639:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1dc03 00000100:00080000:3.0:1787790801.364649:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9170ff55d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790801.364699:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787790801.364893:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+2:2399:x1874634250154880:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 281us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790801.364900:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00010000:00010000:3.0:1787790801.364921:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787790801.365279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787790801.739064:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790802.763164:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790802.763189:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268065664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790802.763256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790802.763386:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268065536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790802.763428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790802.763570:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065664 00000100:00100000:0.0:1787790802.763675:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065664 00000100:00100000:0.0:1787790802.763759:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065536 00000100:00100000:0.0:1787790802.763763:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065536 00000100:00100000:0.0:1787790802.763780:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790802.763788:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268065664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790802.763815:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790802.763859:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268065664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790802.763866:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790802.763882:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787790802.763887:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268065536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790802.763896:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790802.763917:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268065536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790802.763923:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1787790802.763969:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39e70c0 x1874634268065664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790802.763987:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268065664:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787790802.764052:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790802.764075:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbdc9e00 x1874634268065536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790802.764087:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268065536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787790802.764677:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790803.787097:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790803.787268:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268065792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790803.787355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790803.787656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065792 00000100:00100000:2.0:1787790803.787666:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065792 00000100:00100000:2.0:1787790803.787749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787790803.787759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268065792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790803.787794:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790803.787850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268065792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790803.787857:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787790803.787941:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268065792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790803.788325:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790803.788348:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268065920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790803.788383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790803.788565:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268065920 00000100:00100000:3.0:1787790803.788570:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268065920 00000100:00100000:3.0:1787790803.788607:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787790803.788615:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268065920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790803.788638:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787790803.788685:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268065920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790803.788736:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787790803.788895:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268065920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787790804.811071:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790805.322954:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790805.322982:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268066432:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.323057:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268066304:0@lo:400:kworker.0 00000100:00100000:3.0:1787790805.323069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.323138:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268066560:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.323212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790805.323258:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268066816:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.323280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790805.323310:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268067328:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.323331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790805.323349:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787790805.323355:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268066048:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323453:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.323490:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268067072:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.323550:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268067584:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.323586:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787790805.323592:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268066944:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323611:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.323625:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268067456:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.323671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066304 00000100:00100000:2.0:1787790805.323678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066304 00000100:00100000:2.0:1787790805.323748:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066816 00000100:00100000:2.0:1787790805.323758:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066816 00000100:00100000:2.0:1787790805.323788:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067328 00000100:00100000:2.0:1787790805.323791:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067328 00000100:00100000:2.0:1787790805.323806:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066944 00000100:00100000:2.0:1787790805.323808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066944 00000100:00100000:2.0:1787790805.323820:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067456 00000100:00100000:2.0:1787790805.323823:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067456 00000100:00100000:2.0:1787790805.323839:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787790805.323848:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268066304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323894:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268066304:12345-0@lo:400:kworker.0 Request processed in 47us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.323902:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787790805.323918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787790805.323924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268066816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.323968:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268066816:12345-0@lo:400:kworker.0 Request processed in 44us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.323974:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787790805.323986:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787790805.323992:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268067328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.324020:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268067328:12345-0@lo:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324026:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787790805.324037:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787790805.324043:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268066944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.324074:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268066944:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787790805.324099:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787790805.324106:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268067456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.324137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268067456:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324143:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787790805.324162:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067072 00000100:00100000:2.0:1787790805.324165:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067072 00000100:00100000:2.0:1787790805.324190:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067584 00000100:00100000:2.0:1787790805.324192:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067584 00000100:00100000:2.0:1787790805.324211:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787790805.324219:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268067072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.324249:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268067072:12345-0@lo:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324255:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787790805.324266:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787790805.324272:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268067584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.324303:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268067584:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324308:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787790805.324328:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066432 00000100:00100000:2.0:1787790805.324332:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066432 00000100:00100000:2.0:1787790805.324352:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066560 00000100:00100000:2.0:1787790805.324355:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066560 00000100:00100000:0.0:1787790805.324675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790805.324687:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268067840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790805.324701:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787790805.324734:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268066432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790805.324741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790805.324773:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067840 00000100:00100000:0.0:1787790805.324777:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067840 00000100:00100000:2.0:1787790805.324785:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268066432:12345-0@lo:400:kworker.0 Request processed in 54us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324806:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787790805.324810:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787790805.324828:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787790805.324836:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268066560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.324868:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268066560:12345-0@lo:400:kworker.0 Request processed in 34us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.324873:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00080000:2.0:1787790805.324911:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170d11c9e00 x1874634268066944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790805.324925:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268066944:0@lo:400:kworker.0 00010000:00080000:2.0:1787790805.324938:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170d11c9a40 x1874634268067456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790805.325017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790805.325041:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268066688:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790805.325073:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268067200:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790805.325103:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268067712:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.325124:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268067456:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325141:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268066304:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.325147:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268066560:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325157:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268066816:0@lo:400:kworker.0 00010000:00080000:2.0:1787790805.325166:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170d11c83c0 x1874634268067072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790805.325172:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268067328:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.325181:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268067072:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.325199:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268067584:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325210:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066688 00000100:00100000:1.0:1787790805.325215:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066688 00000100:00100000:2.0:1787790805.325231:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067200 00000100:00100000:2.0:1787790805.325235:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067200 00000100:00100000:1.0:1787790805.325246:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787790805.325255:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268066688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.325265:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067712 00000100:00100000:2.0:1787790805.325268:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067712 00000100:00100000:2.0:1787790805.325286:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787790805.325294:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268067200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325298:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268066688:12345-0@lo:400:kworker.0 Request processed in 45us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790805.325311:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1787790805.325335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790805.325339:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790805.325341:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268067200:12345-0@lo:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00080000:1.0:1787790805.325342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790805.325346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790805.325351:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787790805.325379:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268066688:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.325382:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787790805.325395:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268067712:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787790805.325396:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170d11c8780 x1874634268067200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790805.325409:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268067200:0@lo:400:kworker.0 00000100:00100000:2.0:1787790805.325445:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268067712:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.325451:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787790805.325468:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268067712:0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325522:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066048 00000100:00100000:1.0:1787790805.325525:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066048 00000100:00100000:1.0:1787790805.325552:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787790805.325559:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268066048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790805.325592:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268066048:12345-0@lo:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790805.325598:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787790805.325626:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268066048:0@lo:400:kworker.0 00000100:00100000:0.0:1787790805.326032:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268067840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790805.326065:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790805.326103:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268067840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1286us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790805.326110:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787790805.326193:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268067840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790805.330784:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268066432:0@lo:400:kworker.0 00000100:00100000:3.0:1787790805.330801:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268066176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790805.330862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790805.331101:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268066176 00000100:00100000:2.0:1787790805.331109:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268066176 00000100:00100000:2.0:1787790805.331164:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787790805.331174:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268066176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787790805.331212:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790805.331267:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268066176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790805.331275:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787790805.331483:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268066176:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787790805.836105:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790806.479964:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790806.480014:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790806.480042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790806.480068:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790806.480092:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790806.480126:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155264 00000100:00100000:1.0:1787790806.480135:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155264 00000100:00100000:1.0:1787790806.480200:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 371 00000100:00100000:1.0:1787790806.480209:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250155264:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790806.480275:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250155264:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 67us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790806.480299:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 371 00000100:00100000:1.0:1787790806.480333:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155392 00000100:00100000:1.0:1787790806.480336:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155392 00000100:00100000:1.0:1787790806.480371:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155648 00000100:00100000:1.0:1787790806.480374:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155648 00000100:00100000:1.0:1787790806.480389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155520 00000100:00100000:1.0:1787790806.480391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155520 00000100:00100000:1.0:1787790806.480405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155776 00000100:00100000:1.0:1787790806.480408:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155776 00000100:00100000:1.0:1787790806.480422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 235 00000100:00100000:1.0:1787790806.480429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250155392:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790806.480462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250155392:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 34us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790806.480468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 235 00000100:00100000:1.0:1787790806.480481:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 236 00000100:00100000:1.0:1787790806.480487:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250155648:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790806.480542:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250155648:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 55us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790806.480548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 236 00000100:00100000:1.0:1787790806.480560:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 237 00000100:00100000:1.0:1787790806.480566:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250155520:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790806.480592:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250155520:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790806.480599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 237 00000100:00100000:1.0:1787790806.480611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 238 00000100:00100000:1.0:1787790806.480626:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250155776:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790806.480668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250155776:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 43us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790806.480673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 238 00000100:00080000:1.0:1787790806.480699:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790806.480726:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787790806.859381:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787790806.861270:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:3.0:1787790806.861280:0:9504:0:(genops.c:885:class_export_put()) final put ffff9170ff558800/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:0.0:1787790806.861362:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ff558800/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-OST0001 00000020:00000080:0.0:1787790806.861418:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ff55d000 for lustre-OST0001 00010000:00010000:2.0:1787790807.883064:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790807.886549:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790807.886671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790807.886798:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268067968 00000100:00100000:1.0:1787790807.886806:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268067968 00000100:00100000:1.0:1787790807.886866:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787790807.886876:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268067968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790807.886907:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790807.886955:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268067968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790807.886962:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787790807.886984:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790807.887017:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170d11c8b40 x1874634268067968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790807.887036:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790807.889341:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790807.889371:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268068096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790807.889440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790807.889501:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068096 00000100:00100000:2.0:1787790807.889509:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068096 00000100:00100000:2.0:1787790807.889575:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787790807.889584:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268068096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790807.889608:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790807.889649:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268068096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790807.889682:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787790807.889728:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787790807.889758:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373e940 x1874634268068096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790807.889774:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268068096:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787790808.094889:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787790808.164292:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787790808.907072:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268068224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790808.907153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790808.907214:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790808.907220:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268068352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790808.907257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790808.907291:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068224 00000100:00100000:1.0:1787790808.907297:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068224 00000100:00100000:1.0:1787790808.907333:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068352 00000100:00100000:1.0:1787790808.907336:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068352 00000100:00100000:1.0:1787790808.907350:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787790808.907358:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268068224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790808.907393:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790808.907437:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268068224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790808.907444:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787790808.907463:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787790808.907470:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268068352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790808.907495:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790808.907524:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268068352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790808.907529:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787790808.907576:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268068352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790808.907590:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268068224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787790808.908080:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790809.931148:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790810.443685:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268068480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790810.443816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.444347:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068480 00000100:00100000:3.0:1787790810.444356:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068480 00000100:00100000:3.0:1787790810.444431:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790810.444444:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268068480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790810.444493:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790810.444560:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268068480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.444568:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787790810.446364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790810.446475:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268068480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790810.453446:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268068608:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453614:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268069120:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453680:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c82783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268069632:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453761:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787790810.453767:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268068992:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453816:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8279e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268069504:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453860:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8279a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268070016:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453912:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268068736:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453959:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c827bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268069248:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.453982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.453996:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268069760:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.454034:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787790810.454039:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268068864:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.454079:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268069376:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.454131:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268069888:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790810.454184:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068608 00000100:00100000:3.0:1787790810.454192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068608 00000100:00100000:3.0:1787790810.454248:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787790810.454264:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268068608:12345-0@lo:400:kworker.0 Request processed in 60us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454330:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787790810.454367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069120 00000100:00100000:3.0:1787790810.454371:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069120 00000100:00100000:3.0:1787790810.454391:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068736 00000100:00100000:3.0:1787790810.454394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068736 00000100:00100000:3.0:1787790810.454404:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069248 00000100:00100000:3.0:1787790810.454406:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069248 00000100:00100000:3.0:1787790810.454428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069760 00000100:00100000:3.0:1787790810.454431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069760 00000100:00100000:3.0:1787790810.454446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069376 00000100:00100000:3.0:1787790810.454448:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069376 00000100:00100000:3.0:1787790810.454470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069888 00000100:00100000:3.0:1787790810.454473:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069888 00000100:00100000:3.0:1787790810.454490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787790810.454496:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8279680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268069120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454530:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8279680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268069120:12345-0@lo:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787790810.454547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787790810.454552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268068736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454583:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268068736:12345-0@lo:400:kworker.0 Request processed in 30us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787790810.454599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787790810.454604:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268069248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268069248:12345-0@lo:400:kworker.0 Request processed in 39us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787790810.454662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787790810.454668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268069760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454694:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268069760:12345-0@lo:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454700:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787790810.454735:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787790810.454741:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268069376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454770:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268069376:12345-0@lo:400:kworker.0 Request processed in 29us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787790810.454787:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787790810.454792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8278f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268069888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454819:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8278f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268069888:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454825:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787790810.454845:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068992 00000100:00100000:3.0:1787790810.454848:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068992 00000100:00100000:3.0:1787790810.454873:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268068864 00000100:00100000:3.0:1787790810.454876:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268068864 00000100:00100000:3.0:1787790810.454890:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787790810.454896:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268068992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454931:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268068992:12345-0@lo:400:kworker.0 Request processed in 35us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.454948:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787790810.454960:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787790810.454966:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c82792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268068864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.454998:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c82792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268068864:12345-0@lo:400:kworker.0 Request processed in 31us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.455004:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787790810.455023:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069632 00000100:00100000:3.0:1787790810.455026:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069632 00000100:00100000:3.0:1787790810.455049:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268069504 00000100:00100000:3.0:1787790810.455053:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268069504 00000100:00100000:3.0:1787790810.455065:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070016 00000100:00100000:3.0:1787790810.455069:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070016 00000100:00100000:3.0:1787790810.455085:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787790810.455092:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268069632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455123:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268069632:12345-0@lo:400:kworker.0 Request processed in 33us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.455129:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787790810.455139:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787790810.455144:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268069504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455191:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268069504:12345-0@lo:400:kworker.0 Request processed in 46us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.455197:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787790810.455415:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787790810.455422:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268070016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455454:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268070016:12345-0@lo:400:kworker.0 Request processed in 33us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790810.455482:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787790810.455554:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268068864:0@lo:400:kworker.0 00010000:00080000:3.0:1787790810.455571:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170c8278b40 x1874634268069376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790810.455584:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268069376:0@lo:400:kworker.0 00010000:00080000:3.0:1787790810.455596:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170c827b840 x1874634268069888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790810.455605:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268069888:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268068736:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455628:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c827bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268069248:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455638:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268069760:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455693:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268068992:0@lo:400:kworker.0 00010000:00080000:3.0:1787790810.455728:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170c8279e00 x1874634268069504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790810.455739:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8279e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268069504:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455752:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8279a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268070016:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455762:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268068608:0@lo:400:kworker.0 00000100:00100000:3.0:1787790810.455774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268069120:0@lo:400:kworker.0 00010000:00080000:3.0:1787790810.455785:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170c82783c0 x1874634268069632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790810.455802:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c82783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268069632:0@lo:400:kworker.0 00000100:00080000:2.0:1787790810.457375:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790810.457384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790810.457388:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790810.457391:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790810.457413:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790810.457433:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790810.457519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790810.457578:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070144 00000100:00100000:2.0:1787790810.457586:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070144 00000100:00100000:2.0:1787790810.457642:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790810.457652:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268070144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790810.457678:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790810.457745:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268070144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790810.457752:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790810.457806:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268070144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787790810.957921:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790811.596992:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790811.597117:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790811.597149:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790811.597394:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790811.597412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156032 00000100:00100000:0.0:1787790811.597422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156032 00000100:00100000:0.0:1787790811.597497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156160 00000100:00100000:0.0:1787790811.597501:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156160 00000100:00100000:0.0:1787790811.597528:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 245 00000100:00100000:0.0:1787790811.597539:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c82783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250156032:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790811.597637:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c82783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250156032:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 99us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790811.597644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 245 00000100:00100000:0.0:1787790811.597666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 246 00000100:00100000:0.0:1787790811.597673:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8279a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250156160:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790811.597698:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8279a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250156160:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790811.597738:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 246 00000100:00080000:0.0:1787790811.597825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790811.597829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790811.598166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250155904 00000100:00100000:0.0:1787790811.598171:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250155904 00000100:00100000:0.0:1787790811.598297:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 373 00000100:00100000:0.0:1787790811.598377:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250155904:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790811.598865:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250155904:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 559us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790811.598875:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 373 00000100:00100000:0.0:1787790811.599304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156416 00000100:00100000:0.0:1787790811.599374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156416 00000100:00100000:0.0:1787790811.599415:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 247 00000100:00100000:0.0:1787790811.599423:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8279e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250156416:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790811.599470:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8279e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250156416:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 47us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790811.599477:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 247 00000100:00080000:0.0:1787790811.599493:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790811.599647:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790811.599873:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156288 00000100:00100000:0.0:1787790811.599878:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156288 00000100:00100000:0.0:1787790811.600045:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 248 00000100:00100000:0.0:1787790811.600053:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8278780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250156288:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790811.600090:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8278780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250156288:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00080000:3.0:1787790811.600176:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790811.600277:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 248 00010000:00010000:0.0:1787790811.978948:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790813.002956:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790813.002988:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268070272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790813.003091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790813.003165:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790813.003181:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070272 00000100:00100000:2.0:1787790813.003190:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070272 00000100:00100000:2.0:1787790813.003257:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787790813.003269:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268070272:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787790813.003297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787790813.003306:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790813.003374:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268070272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790813.003381:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1787790813.003406:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373c000 x1874634268070272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790813.003430:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268070272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790813.005813:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268070400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790813.005897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790813.006038:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070400 00000100:00100000:2.0:1787790813.006048:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070400 00000100:00100000:2.0:1787790813.006130:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787790813.006140:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268070400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790813.006164:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790813.006211:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268070400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790813.006218:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787790813.006549:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790813.006582:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc373f840 x1874634268070400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790813.006624:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268070400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790814.026992:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790814.027739:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268070656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790814.027848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790814.027943:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790814.027951:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268070528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790814.027978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790814.028380:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070656 00000100:00100000:1.0:1787790814.028391:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070656 00000100:00100000:1.0:1787790814.028466:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070528 00000100:00100000:1.0:1787790814.028470:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070528 00000100:00100000:1.0:1787790814.028490:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787790814.028501:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268070656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790814.028573:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790814.028651:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268070656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790814.028659:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787790814.028680:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787790814.028686:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268070528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790814.028726:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790814.028760:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268070528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790814.028765:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787790814.029334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268070528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790814.029353:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268070656:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787790815.054310:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787790815.331198:0:14052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:33:34 (1787790814) 00000100:00100000:3.0:1787790815.562995:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268071040:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.563112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.563179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268071552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.563210:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.563228:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268072064:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.563255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.563297:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787790815.563303:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c827bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268071168:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.563465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.563489:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268071680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.563530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.563788:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268072192:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.563830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.563877:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071040 00000100:00100000:3.0:1787790815.563886:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071040 00000100:00100000:3.0:1787790815.563942:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071168 00000100:00100000:3.0:1787790815.563946:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071168 00000100:00100000:3.0:1787790815.563965:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787790815.563974:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.564041:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268071040:12345-0@lo:400:kworker.0 Request processed in 67us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790815.564049:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787790815.564070:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787790815.564076:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268071168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.564246:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268071168:12345-0@lo:400:kworker.0 Request processed in 169us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790815.564253:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787790815.564473:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268070912:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564549:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268071424:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564606:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268071936:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564654:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787790815.564660:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268070784:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564739:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268071296:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564777:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268071808:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564816:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268072320:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.564839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.564916:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071552 00000100:00100000:2.0:1787790815.564921:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071552 00000100:00100000:2.0:1787790815.564964:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072064 00000100:00100000:2.0:1787790815.564968:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072064 00000100:00100000:2.0:1787790815.564983:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070912 00000100:00100000:2.0:1787790815.564985:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070912 00000100:00100000:2.0:1787790815.564995:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071424 00000100:00100000:2.0:1787790815.564997:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071424 00000100:00100000:2.0:1787790815.565010:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071936 00000100:00100000:2.0:1787790815.565012:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071936 00000100:00100000:2.0:1787790815.565024:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071296 00000100:00100000:2.0:1787790815.565026:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071296 00000100:00100000:2.0:1787790815.565041:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787790815.565047:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268071552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565108:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268071552:12345-0@lo:400:kworker.0 Request processed in 60us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565127:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787790815.565147:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787790815.565154:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268072064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565185:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268072064:12345-0@lo:400:kworker.0 Request processed in 33us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565191:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787790815.565202:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787790815.565207:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268070912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565232:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268070912:12345-0@lo:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565238:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787790815.565246:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787790815.565251:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268071424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565291:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268071424:12345-0@lo:400:kworker.0 Request processed in 40us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565296:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787790815.565307:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787790815.565311:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268071936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565347:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268071936:12345-0@lo:400:kworker.0 Request processed in 35us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565353:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787790815.565366:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787790815.565371:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268071296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565399:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268071296:12345-0@lo:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565411:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787790815.565449:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268070784 00000100:00100000:2.0:1787790815.565454:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268070784 00000100:00100000:2.0:1787790815.565484:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787790815.565491:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268070784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565526:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268070784:12345-0@lo:400:kworker.0 Request processed in 36us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565533:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787790815.565570:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071680 00000100:00100000:2.0:1787790815.565574:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071680 00000100:00100000:2.0:1787790815.565597:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072192 00000100:00100000:2.0:1787790815.565600:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072192 00000100:00100000:2.0:1787790815.565615:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268071808 00000100:00100000:2.0:1787790815.565617:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268071808 00000100:00100000:2.0:1787790815.565633:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072320 00000100:00100000:2.0:1787790815.565636:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072320 00000100:00100000:2.0:1787790815.565650:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787790815.565656:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268071680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565691:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268071680:12345-0@lo:400:kworker.0 Request processed in 34us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565697:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787790815.565731:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787790815.565738:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268072192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565770:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268072192:12345-0@lo:400:kworker.0 Request processed in 33us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565775:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787790815.565786:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787790815.565800:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268071808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565830:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268071808:12345-0@lo:400:kworker.0 Request processed in 31us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565836:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787790815.565846:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787790815.565852:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268072320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.565879:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268072320:12345-0@lo:400:kworker.0 Request processed in 28us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.565886:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787790815.565919:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268072448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790815.565955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790815.566003:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268070784:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.566018:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268071296:0@lo:400:kworker.0 00010000:00080000:2.0:1787790815.566032:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc2642580 x1874634268071808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790815.566043:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268071808:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.566052:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268072320:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.566063:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268070912:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.566073:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268071424:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.566084:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268071936:0@lo:400:kworker.0 00000100:00100000:2.0:1787790815.566137:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072448 00000100:00100000:2.0:1787790815.566141:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072448 00000100:00100000:2.0:1787790815.566177:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787790815.566183:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268072448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790815.566213:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790815.566252:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268072448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.566258:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787790815.566293:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268072448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790815.566871:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268072576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790815.566913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790815.566961:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c827bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268071168:0@lo:400:kworker.0 00010000:00080000:3.0:1787790815.566974:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bd680 x1874634268071680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790815.566983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268071680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.566994:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268072192:0@lo:400:kworker.0 00000100:00100000:3.0:1787790815.567006:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268071040:0@lo:400:kworker.0 00010000:00080000:3.0:1787790815.567018:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37bcf00 x1874634268071552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790815.567036:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268071552:0@lo:400:kworker.0 00010000:00080000:3.0:1787790815.567050:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc2641680 x1874634268072064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790815.567058:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268072064:0@lo:400:kworker.0 00000100:00080000:0.0:1787790815.567624:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787790815.567632:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790815.567636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790815.567639:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790815.568184:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072576 00000100:00100000:2.0:1787790815.568195:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072576 00000100:00100000:2.0:1787790815.568257:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787790815.568275:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268072576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787790815.568302:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790815.568398:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268072576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790815.568406:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787790815.568965:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268072576:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787790816.075098:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790816.596865:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790816.597632:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156544 00000100:00100000:2.0:1787790816.597647:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156544 00000100:00100000:2.0:1787790816.597803:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:2.0:1787790816.597817:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:11071:x1874634250156544:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790816.597850:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787790816.598146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790816.598149:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dce3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b7b expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.598310:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dcea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.598345:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dcea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.598362:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dcea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790816.598428:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790816.598433:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790816.598477:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dcea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.598507:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dce3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b7b expref: 7 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.598531:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dcea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b7b expref: 6 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.598541:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:2.0:1787790816.598544:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790816.598548:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790816.598629:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:11071:x1874634250156544:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 816us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790816.598638:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:1.0:1787790816.615498:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790816.615929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156672 00000100:00100000:0.0:1787790816.615945:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156672 00000100:00100000:0.0:1787790816.616051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:0.0:1787790816.616065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:11072:x1874634250156672:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790816.616096:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790816.616131:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dcf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b82 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616252:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616271:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616287:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616308:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616322:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616420:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4400/0xcf9477fddcf1dd06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616429:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4400/0xcf9477fddcf1dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616436:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4400/0xcf9477fddcf1dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790816.616496:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790816.616501:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790816.616549:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4400/0xcf9477fddcf1dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616583:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616591:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616598:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616606:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790816.616612:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616621:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616635:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:0.0:1787790816.616639:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790816.616645:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616653:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1dcf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616672:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616678:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616684:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790816.616785:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616792:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616802:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9170e15d8d00) 00010000:00010000:0.0:1787790816.616804:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790816.616807:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616813:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dcff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616856:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dcf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b82 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616873:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4400/0xcf9477fddcf1dd06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b82 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790816.616881:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e15d8800) 00010000:00010000:0.0:1787790816.616884:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790816.616886:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4400, rc 0) 00000100:00100000:0.0:1787790816.616972:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:11072:x1874634250156672:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 909us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790816.616982:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:0.0:1787790816.633328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790816.633516:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250156800 00000100:00100000:1.0:1787790816.633532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250156800 00000100:00100000:1.0:1787790816.633633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787790816.633648:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a61a333f-852a-40de-8207-4f7de209a9a4+7:11072:x1874634250156800:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787790816.633835:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a61a333f-852a-40de-8207-4f7de209a9a4+7:11072:x1874634250156800:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 Request processed in 190us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790816.633844:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:0.0:1787790816.647143:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790816.647342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157056 00000100:00100000:2.0:1787790816.647360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157056 00000100:00100000:2.0:1787790816.647464:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:2.0:1787790816.647479:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:11072:x1874634250157056:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790816.647516:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790816.647580:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dd0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b89 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.647697:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.647767:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.647783:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.648048:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.648080:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.648096:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.650018:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1dd22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.650040:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1dd22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.650052:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1dd22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790816.650065:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787790816.658958:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659008:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659015:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659021:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790816.659026:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659033:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659052:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e15d8800) 00010000:00010000:2.0:1787790816.659056:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790816.659061:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659067:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1dd14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659082:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659087:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659092:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659097:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790816.659106:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659112:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659120:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff916fc3700f00) 00010000:00010000:2.0:1787790816.659122:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790816.659126:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.659131:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1dd1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.661095:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dd0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b89 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.661124:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1dd22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b89 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790816.661133:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:2.0:1787790816.661135:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790816.661140:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995800, rc 0) 00000100:00100000:2.0:1787790816.661211:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:11072:x1874634250157056:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 13734us (14084us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787790816.661221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:0.0:1787790816.678211:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790816.678576:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157184 00000100:00100000:3.0:1787790816.678587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157184 00000100:00100000:3.0:1787790816.678667:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:3.0:1787790816.678679:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:11072:x1874634250157184:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787790816.678855:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:11072:x1874634250157184:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 178us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790816.678875:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:0.0:1787790816.688084:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790816.688437:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157312 00000100:00100000:1.0:1787790816.688448:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157312 00000100:00100000:1.0:1787790816.688530:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:1.0:1787790816.688542:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:11072:x1874634250157312:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787790816.689845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787790816.693978:0:10094:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5377us 00000100:00100000:0.0:1787790816.709110:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790816.709163:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790816.709198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790816.709612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157696 00000100:00100000:2.0:1787790816.709625:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157696 00000100:00100000:2.0:1787790816.709697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157568 00000100:00100000:2.0:1787790816.709700:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157568 00000100:00100000:2.0:1787790816.709784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 255 00000100:00100000:2.0:1787790816.709793:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250157696:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790816.709882:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250157696:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 90us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790816.709890:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 255 00000100:00100000:2.0:1787790816.710195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 256 00000100:00100000:2.0:1787790816.710204:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250157568:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790816.710508:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250157568:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 303us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790816.710516:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 256 00000100:00100000:3.0:1787790816.710688:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157440 00000100:00100000:3.0:1787790816.710695:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157440 00000100:00100000:3.0:1787790816.710766:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 375 00000100:00100000:3.0:1787790816.710774:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250157440:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790816.710804:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c29d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250157440:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 32us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790816.710811:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 375 00000100:00080000:0.0:1787790816.710952:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790816.710958:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790816.741236:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:11072:x1874634250157312:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 52677us (53148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790816.741252:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00010000:00010000:2.0:1787790817.101807:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790817.297786:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787790817.421346:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787790818.122974:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790818.123653:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268072704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790818.123776:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790818.123912:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072704 00000100:00100000:2.0:1787790818.123922:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072704 00000100:00100000:2.0:1787790818.124000:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787790818.124013:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3739e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268072704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790818.124052:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790818.124105:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3739e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268072704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790818.124112:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787790818.124307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787790818.124343:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d43c0 x1874634268072704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790818.124365:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268072704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790818.126173:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790818.126203:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268072832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790818.126302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790818.126756:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072832 00000100:00100000:2.0:1787790818.126767:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072832 00000100:00100000:2.0:1787790818.126843:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787790818.126863:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268072832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790818.126894:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790818.126973:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268072832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790818.126980:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1787790818.127164:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787790818.127259:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d43c0 x1874634268072832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790818.127283:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268072832:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787790818.316870:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787790818.443674:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787790819.146995:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790819.147915:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790819.147946:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268072960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790819.148082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790819.148168:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268072960 00000100:00100000:1.0:1787790819.148177:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268072960 00000100:00100000:1.0:1787790819.148234:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787790819.148245:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268072960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790819.148292:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787790819.148349:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268072960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790819.148357:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787790819.148425:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268072960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790819.149333:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268073088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790819.149403:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790819.149500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268073088 00000100:00100000:1.0:1787790819.149507:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268073088 00000100:00100000:1.0:1787790819.149565:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787790819.149575:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268073088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790819.149606:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787790819.162168:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268073088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12574us (12744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790819.162193:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787790819.169742:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268073088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790819.817646:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790819.819162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250157824 00000100:00100000:0.0:1787790819.819177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250157824 00000100:00100000:0.0:1787790819.819274:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:0.0:1787790819.819286:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:11115:x1874634250157824:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790819.819306:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790819.819326:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820204:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820231:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820248:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820277:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820286:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820300:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820356:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820364:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820371:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820389:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790819.820394:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820424:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820438:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:0.0:1787790819.820442:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790819.820453:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820460:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820482:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820511:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820518:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820524:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790819.820526:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820533:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820541:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9170e15d8d00) 00010000:00010000:0.0:1787790819.820544:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790819.820547:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820570:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820622:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b90 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820639:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:0.0:1787790819.820642:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790819.820646:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b90 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.820663:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4800, rc 0) 00000100:00100000:0.0:1787790819.820774:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:11115:x1874634250157824:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1491us (3143us total) trans 0 rc 301/301 00000100:00100000:0.0:1787790819.820784:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00080000:3.0:1787790819.820966:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790819.827407:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790819.827447:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158080 00000100:00100000:3.0:1787790819.827456:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158080 00000100:00100000:0.0:1787790819.827585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:0.0:1787790819.827598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4e22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+9:11115:x1874634250158080:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:0.0:1787790819.827666:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790819.827694:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dcea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b7b expref: 9 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.827732:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700100) 00010000:00010000:0.0:1787790819.827746:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790819.827804:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.827829:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.827849:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.827863:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.827871:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.827878:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828481:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828506:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828515:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790819.828531:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023732043 reply state 00000000f4691147 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828543:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828549:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790819.828553:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790819.828556:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787790819.828561:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787790819.828569:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828584:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828592:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828599:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790819.828604:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828612:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828623:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170e15d8b00) 00010000:00010000:0.0:1787790819.828626:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790819.828630:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828637:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd45 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790819.828653:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023732043 reply state 00000000f4691147 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828662:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790819.828670:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9170e15d8900) 00010000:00010000:0.0:1787790819.828673:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790819.828675:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787790819.828806:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4e22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:11115:x1874634250158080:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 1210us (1408us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787790819.828821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:0.0:1787790819.944038:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790819.944199:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158208 00000100:00100000:2.0:1787790819.944209:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158208 00000100:00100000:2.0:1787790819.944266:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:2.0:1787790819.944276:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+10:11123:x1874634250158208:12345-192.168.202.22@tcp:101:lctl.0 00010000:00010000:2.0:1787790819.944300:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790819.944323:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dd5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b97 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790819.944427:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dd61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790819.944444:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790819.944456:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790819.944520:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790819.944524:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790819.944564:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790819.944588:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dd5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b97 expref: 12 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790819.944624:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dd61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b97 expref: 11 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790819.944634:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:2.0:1787790819.944637:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790819.944640:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790819.944761:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+11:11123:x1874634250158208:12345-192.168.202.22@tcp:101:lctl.0 Request processed in 486us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790819.944768:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:1.0:1787790820.047924:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.048062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158336 00000100:00100000:0.0:1787790820.048073:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158336 00000100:00100000:0.0:1787790820.048148:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:0.0:1787790820.048166:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+11:11129:x1874634250158336:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790820.048199:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790820.048224:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223b9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048312:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048364:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048403:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048411:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048418:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048534:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048555:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048562:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790820.048612:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787790820.048617:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790820.048668:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048830:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048839:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048846:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048852:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.048856:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048864:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048876:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:0.0:1787790820.048879:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790820.048884:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048899:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dd6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048913:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048919:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048924:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048929:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.048932:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048948:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048957:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9170e15d8900) 00010000:00010000:0.0:1787790820.048959:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790820.048962:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048968:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dd76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.048995:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b9e expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.049009:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b9e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.049022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790820.049025:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787790820.049028:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4c00, rc 0) 00000100:00100000:0.0:1787790820.049097:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+12:11129:x1874634250158336:12345-192.168.202.22@tcp:101:bash.0 Request processed in 940us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790820.049105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:3.0:1787790820.055360:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.056743:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158592 00000100:00100000:0.0:1787790820.056758:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158592 00000100:00100000:0.0:1787790820.056832:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:0.0:1787790820.056844:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+12:11129:x1874634250158592:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790820.056870:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790820.056895:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dd84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ba5 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.057788:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.057807:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.057822:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.057880:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.057890:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.057916:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790820.058991:0:10093:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787790820.060324:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060344:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060356:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060410:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060417:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060424:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060431:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.060436:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060444:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060457:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790820.060461:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790820.060480:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060487:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dd8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790820.060501:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008e0a1ba reply state 000000000da3449a transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.060513:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.061106:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:0.0:1787790820.061113:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790820.061118:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787790820.061280:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dd84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 15 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.061300:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 14 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.061308:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790820.061311:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790820.061313:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5200, rc 0) 00000100:00100000:0.0:1787790820.061450:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+15:11129:x1874634250158592:12345-192.168.202.22@tcp:101:bash.0 Request processed in 4607us (6107us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787790820.061460:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:1.0:1787790820.079788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.079936:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158720 00000100:00100000:2.0:1787790820.079947:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158720 00000100:00100000:2.0:1787790820.080002:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787790820.080010:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874634250158720:12345-192.168.202.22@tcp:8:bash.0 00010000:00080000:2.0:1787790820.080049:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:2.0:1787790820.080081:0:8428:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1dda7 00002000:00100000:2.0:1787790820.080094:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a61a333f-852a-40de-8207-4f7de209a9a4/ffff9170c4cc8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787790820.080114:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787790820.080240:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787790820.080270:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170c4cce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790820.080342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250158720:12345-192.168.202.22@tcp:8:bash.0 Request processed in 330us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.080349:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:1.0:1787790820.085416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790820.085513:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158848 00000100:00100000:3.0:1787790820.085533:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158848 00000100:00100000:3.0:1787790820.085612:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787790820.085622:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250158848:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:3.0:1787790820.085640:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790820.085664:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bac expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787790820.085833:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787790820.086004:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790820.086027:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1787790820.086032:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790820.086043:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.086065:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.086098:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fc00, rc 0) 00000100:00100000:3.0:1787790820.086162:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:0:x1874634250158848:12345-192.168.202.22@tcp:101:bash.0 Request processed in 541us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790820.086170:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787790820.095154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.102359:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250158976 00000100:00100000:2.0:1787790820.102386:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250158976 00000100:00100000:2.0:1787790820.102474:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:2.0:1787790820.102486:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:11129:x1874634250158976:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790820.102504:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790820.102685:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bb3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.102844:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.102855:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790820.102859:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790820.102865:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.102905:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.102920:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790820.102935:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1874634268073216:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790820.103088:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790820.113021:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1874634268073216:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790820.113062:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.113104:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995000, rc 0) 00000100:00100000:2.0:1787790820.113169:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:11129:x1874634250158976:12345-192.168.202.22@tcp:101:bash.0 Request processed in 10685us (18025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.113179:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:1.0:1787790820.123008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.123124:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250159104 00000100:00100000:0.0:1787790820.123144:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250159104 00010000:00010000:0.0:1787790820.123197:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790820.123262:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:0.0:1787790820.123273:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c6463450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250159104:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790820.123288:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790820.123313:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.123330:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.123358:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1ddae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bac expref: 8 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.123388:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790820.123394:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790820.123404:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.123415:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.123451:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790820.123466:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874634268073344:192.168.202.22@tcp:105: 00000100:00100000:0.0:1787790820.123554:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37e66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790820.125986:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874634268073344:192.168.202.22@tcp:105: 00010000:00010000:2.0:1787790820.126018:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790820.126076:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c6463450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250159104:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 2804us (3078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.126090:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:1.0:1787790820.131796:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.131917:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250159360 00000100:00100000:0.0:1787790820.131929:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250159360 00000100:00100000:0.0:1787790820.131991:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:0.0:1787790820.132000:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+15:11129:x1874634250159360:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:0.0:1787790820.146668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:11129:x1874634250159360:12345-192.168.202.22@tcp:35:bash.0 Request processed in 14649us (14869us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787790820.146688:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00010000:00010000:2.0:1787790820.171342:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790820.258795:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.258914:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250159616 00000100:00100000:0.0:1787790820.258924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250159616 00000100:00100000:0.0:1787790820.258979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:0.0:1787790820.258987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+16:11139:x1874634250159616:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790820.259007:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790820.259025:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1ddbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790820.259124:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787790820.259242:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1ddbc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bba expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.259257:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:0.0:1787790820.259261:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790820.259266:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1ddbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bba expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.259280:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5a00, rc 0) 00000100:00100000:0.0:1787790820.259342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+17:11139:x1874634250159616:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 354us (554us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787790820.259361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:3.0:1787790820.264192:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.268120:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250159872 00000100:00100000:2.0:1787790820.268135:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250159872 00000100:00100000:2.0:1787790820.268202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787790820.268213:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+17:11139:x1874634250159872:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790820.268487:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:11139:x1874634250159872:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 275us (4305us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787790820.268495:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787790820.385589:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.385695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250160000 00000100:00100000:2.0:1787790820.385746:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250160000 00000100:00100000:2.0:1787790820.385808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:2.0:1787790820.385819:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:11145:x1874634250160000:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790820.385843:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790820.385868:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1ddca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bc1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.385976:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1ddd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.385991:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.386002:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790820.386044:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787790820.386047:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790820.386462:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.386492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1ddca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bc1 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.386512:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1ddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bc1 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.386520:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790820.386523:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790820.386527:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994600, rc 0) 00000100:00100000:2.0:1787790820.386596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:11145:x1874634250160000:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 778us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.386604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:2.0:1787790820.395078:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.395193:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250160256 00000100:00100000:0.0:1787790820.395205:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250160256 00000100:00100000:0.0:1787790820.395268:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:0.0:1787790820.395279:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+19:11145:x1874634250160256:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790820.395301:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790820.395322:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1ddd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bc8 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.395445:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dddf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.395461:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.395471:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790820.395482:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787790820.395593:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1ddd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bc8 expref: 22 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.395612:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dddf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bc8 expref: 21 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.395620:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790820.395624:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790820.395627:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4200, rc 0) 00000100:00100000:0.0:1787790820.395749:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:11145:x1874634250160256:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 471us (676us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787790820.395757:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:3.0:1787790820.402103:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.402409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250160512 00000100:00100000:0.0:1787790820.402419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250160512 00000100:00100000:0.0:1787790820.402481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:0.0:1787790820.402492:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:11145:x1874634250160512:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790820.402518:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790820.402547:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dded lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bcf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.402669:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1ddf4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.402684:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.402696:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790820.402731:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787790820.402831:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1dded lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bcf expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.402850:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1ddf4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bcf expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.402858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790820.402860:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787790820.403045:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5800, rc 0) 00000100:00100000:0.0:1787790820.403177:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+23:11145:x1874634250160512:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 685us (1083us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787790820.403185:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:3.0:1787790820.422794:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790820.422952:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250160640 00000100:00100000:1.0:1787790820.422981:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250160640 00000100:00100000:1.0:1787790820.423168:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:1.0:1787790820.423178:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:2402:x1874634250160640:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790820.423201:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790820.423234:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1dddf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bc8 expref: 23 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.423262:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:1.0:1787790820.423269:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790820.423348:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:2402:x1874634250160640:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 170us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790820.423356:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787790820.430831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.431198:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250160768 00000100:00100000:0.0:1787790820.431215:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250160768 00000100:00100000:0.0:1787790820.431300:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:0.0:1787790820.431312:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250160768:12345-192.168.202.22@tcp:1:lfs.0 00010000:00010000:0.0:1787790820.431359:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.431391:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.431400:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790820.431404:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790820.431408:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.431452:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.431469:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 7 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790820.431487:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1874634268073472:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790820.431584:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc37e66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790820.436230:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1874634268073472:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790820.436275:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790820.436408:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.437296:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250160896 00000100:00100000:2.0:1787790820.437323:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250160896 00002000:00100000:2.0:1787790820.437397:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff916fc373a580 x1874634250160896/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:661/0 lens 504/0 e 0 to 0 dl 1787790831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790820.437408:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc373a580 with x1874634250160896 ext(0->12) 00010000:00010000:2.0:1787790820.437419:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 8 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.437435:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 8 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790820.437445:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc373a580 00000100:00100000:2.0:1787790820.437488:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:2.0:1787790820.437500:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250160896:12345-192.168.202.22@tcp:4:lfs.0 00000001:00100000:1.0:1787790820.452640:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000100:00100000:2.0:1787790820.457551:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250160896:12345-192.168.202.22@tcp:4:lfs.0 Request processed in 20025us (21126us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787790820.457571:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00002000:00100000:2.0:1787790820.457591:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff916fc373a580 x1874634250160896/t4294967300(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:661/0 lens 504/448 e 0 to 0 dl 1787790831 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790820.457604:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc373a580 with x1874634250160896 ext(0->12) 00010000:00010000:2.0:1787790820.457618:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 9 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.457645:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 9 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790820.457679:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc373a580 00000100:00100000:1.0:1787790820.463349:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790820.464283:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250161024 00000100:00100000:3.0:1787790820.464304:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250161024 00010000:00010000:3.0:1787790820.464369:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 9 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790820.464496:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:3.0:1787790820.464508:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+9:2403:x1874634250161024:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790820.464539:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787790820.464566:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787790820.464570:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787790821 00002000:00010000:3.0:1787790820.464572:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787790821 00002000:00010000:3.0:1787790820.464591:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787790821 00002000:00010000:3.0:1787790820.464593:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787790820.464602:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 9 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.464618:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 9 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.464648:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1ddb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bb3 expref: 9 pid: 8428 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.464672:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790820.464677:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790820.464682:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.464694:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.464774:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790820.464859:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250161024:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 342us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790820.464869:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00010000:00010000:1.0:1787790820.464946:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.464958:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.464981:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.464990:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.464998:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.465025:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790820.465031:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.465042:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.465059:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.465068:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1de02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790820.467421:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250160768:12345-192.168.202.22@tcp:1:lfs.0 Request processed in 36094us (36589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790820.467440:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:1.0:1787790820.478823:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.481750:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250161280 00000100:00100000:2.0:1787790820.481768:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250161280 00000100:00100000:2.0:1787790820.481847:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787790820.481859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:11145:x1874634250161280:12345-192.168.202.22@tcp:35:lfs.0 00000004:00010000:2.0:1787790820.481949:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1ddf4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bcf expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790820.482603:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787790820.482662:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787790820.483585:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1787790820.483646:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.483669:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 26 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.483679:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.483811:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 26 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.483834:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 26 pid: 10093 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790820.483854:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874634268073600:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790820.484058:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790820.489736:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790820.491365:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250161408 00000100:00100000:1.0:1787790820.491391:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250161408 00010000:00010000:1.0:1787790820.491454:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 27 pid: 10093 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790820.491502:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:1.0:1787790820.491514:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:2403:x1874634250161408:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790820.491662:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790820.491689:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 27 pid: 10093 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.491767:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 27 pid: 10093 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.491799:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:1.0:1787790820.491806:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.491817:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.491825:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790820.492209:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790820.492334:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:2403:x1874634250161408:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 820us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790820.492345:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00010000:00010000:2.0:1787790820.492481:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dd99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ba5 expref: 26 pid: 10093 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790820.492504:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874634268073600:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790820.492543:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.492553:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.492559:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790820.492749:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787790820.492896:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787790820.493061:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268073728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790820.493257:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790820.493302:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790820.493388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268073728 00000100:00100000:1.0:1787790820.493395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268073728 00000100:00100000:1.0:1787790820.493463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787790820.493472:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874634268073728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787790820.493569:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874634268073728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790820.493577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1787790820.500739:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790820.500852:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268073728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787790820.501156:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1787790820.501264:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268073856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787790820.501355:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790820.501417:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790820.505979:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268073856 00000100:00100000:1.0:1787790820.506000:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268073856 00000100:00100000:1.0:1787790820.506140:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787790820.506154:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2641680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1874634268073856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787790820.506460:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2641680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1874634268073856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 308us (5104us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787790820.506470:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790820.507278:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268073856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787790820.507398:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787790820.507467:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.507480:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.507489:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.507497:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.507503:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.507512:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.507543:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790820.507547:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787790820.507553:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.507559:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1de09 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790820.507735:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787790820.507815:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787790820.507829:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369456122734ns, next at 370456120344ns, rc = 0 00000001:00080000:0.0:1787790820.507852:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787790820.507880:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790820.507883:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787790820.507892:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1ddf4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bcf expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790820.508041:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:11145:x1874634250161280:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 26184us (29235us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787790820.508052:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000020:00080000:0.0:1787790820.508058:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787790820.513246:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.521779:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250161536 00000100:00100000:2.0:1787790820.521802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250161536 00000100:00100000:2.0:1787790820.521914:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:2.0:1787790820.521948:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:11145:x1874634250161536:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790820.521981:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790820.522012:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1de10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bd6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.522108:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1de10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bd6 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.522140:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1de10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bd6 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.522165:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790820.522169:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790820.522173:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994e00, rc 0) 00000100:00100000:2.0:1787790820.522266:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+30:11145:x1874634250161536:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 322us (9037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.522274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:3.0:1787790820.526941:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.527064:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250161792 00000100:00100000:0.0:1787790820.527078:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250161792 00000100:00100000:0.0:1787790820.527160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:0.0:1787790820.527172:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+30:11145:x1874634250161792:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790820.527472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+31:11145:x1874634250161792:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 301us (546us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787790820.527480:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:1.0:1787790820.650592:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.650770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250162048 00000100:00100000:2.0:1787790820.650783:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250162048 00000100:00100000:2.0:1787790820.650876:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:2.0:1787790820.650890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+31:11155:x1874634250162048:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790820.650934:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790820.650963:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1de17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bdd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790820.651103:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787790820.651265:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1de17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bdd expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.651302:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:2.0:1787790820.651305:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790820.651312:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1de17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bdd expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.651328:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995600, rc 0) 00000100:00100000:2.0:1787790820.651413:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+32:11155:x1874634250162048:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 526us (839us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787790820.651421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:1.0:1787790820.658537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.658692:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250162176 00000100:00100000:0.0:1787790820.658729:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250162176 00000100:00100000:0.0:1787790820.658816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:0.0:1787790820.658830:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+32:11155:x1874634250162176:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:0.0:1787790820.658946:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.658969:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.658984:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659017:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659025:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659033:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659143:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659152:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659159:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790820.659547:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659566:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659573:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659581:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659588:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.659593:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659614:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659631:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790820.659634:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790820.659640:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659646:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1de25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659662:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659668:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659675:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659680:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.659683:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659689:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659696:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:0.0:1787790820.659699:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790820.659701:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659808:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659820:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659826:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659833:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659838:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790820.659841:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659848:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659965:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790820.659967:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790820.659970:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790820.659976:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790820.660084:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+32:11155:x1874634250162176:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 1255us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790820.660094:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:1.0:1787790820.669880:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.670005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250162432 00000100:00100000:0.0:1787790820.670020:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250162432 00000100:00100000:0.0:1787790820.670105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:0.0:1787790820.670118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+32:11155:x1874634250162432:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790820.670459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+33:11155:x1874634250162432:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 342us (614us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787790820.670468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787790820.684995:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268073984:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685161:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268074496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685482:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268075008:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685547:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787790820.685555:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268074368:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685604:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268074880:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685648:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268075392:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685700:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268074112:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685768:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268074624:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685824:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268075136:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685868:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787790820.685874:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268074240:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685915:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268074752:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.685949:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268075264:0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.685989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790820.686027:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268073984 00000100:00100000:1.0:1787790820.686036:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268073984 00000100:00100000:1.0:1787790820.686091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787790820.686101:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268073984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790820.686160:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3641:x1874634268073984:12345-0@lo:400:kworker.0 Request processed in 59us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790820.686167:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787790820.686481:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790820.686493:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268075520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790820.686528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790820.686559:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268075520 00000100:00100000:2.0:1787790820.686564:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268075520 00000100:00100000:2.0:1787790820.686610:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787790820.686618:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268075520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790820.686649:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790820.686690:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268075520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.686696:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787790820.686739:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074880 00000100:00100000:2.0:1787790820.686743:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074880 00000100:00100000:2.0:1787790820.686775:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268075392 00000100:00100000:2.0:1787790820.686778:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268075392 00000100:00100000:2.0:1787790820.686789:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268075264 00000100:00100000:2.0:1787790820.686791:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268075264 00000100:00100000:2.0:1787790820.686819:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787790820.686825:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268074880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.686862:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268074880:12345-0@lo:400:kworker.0 Request processed in 37us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.686868:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787790820.686878:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787790820.686884:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268075392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.686907:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268075392:12345-0@lo:400:kworker.0 Request processed in 24us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.686912:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787790820.686921:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787790820.686927:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268075264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.686962:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268075264:12345-0@lo:400:kworker.0 Request processed in 35us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.686968:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787790820.686985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790820.686989:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790820.687023:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268075520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790820.687079:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268075264:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687119:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074496 00000100:00100000:2.0:1787790820.687122:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074496 00000100:00100000:2.0:1787790820.687144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268075008 00000100:00100000:2.0:1787790820.687148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268075008 00000100:00100000:2.0:1787790820.687165:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074112 00000100:00100000:2.0:1787790820.687168:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074112 00000100:00100000:2.0:1787790820.687190:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074624 00000100:00100000:2.0:1787790820.687194:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074624 00000100:00100000:2.0:1787790820.687220:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268075136 00000100:00100000:2.0:1787790820.687223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268075136 00000100:00100000:2.0:1787790820.687237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074752 00000100:00100000:2.0:1787790820.687239:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074752 00000100:00100000:2.0:1787790820.687254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787790820.687259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268074496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268074496:12345-0@lo:400:kworker.0 Request processed in 34us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687299:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787790820.687311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787790820.687317:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268075008:12345-0@lo:400:kworker.0 Request processed in 26us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687347:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787790820.687356:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787790820.687362:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268074112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687408:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268074112:12345-0@lo:400:kworker.0 Request processed in 46us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687414:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787790820.687426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787790820.687431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268074624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687457:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268074624:12345-0@lo:400:kworker.0 Request processed in 27us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787790820.687471:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787790820.687476:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268075136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687511:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268075136:12345-0@lo:400:kworker.0 Request processed in 35us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687517:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787790820.687529:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787790820.687534:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268074752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268074752:12345-0@lo:400:kworker.0 Request processed in 29us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:2.0:1787790820.687582:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790820.687585:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787790820.687607:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bf0c0 x1874634268074752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790820.687618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268074752:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687631:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268074112:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687641:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268074624:0@lo:400:kworker.0 00010000:00080000:2.0:1787790820.687651:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc39f2d00 x1874634268075136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790820.687660:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268075136:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074368 00000100:00100000:2.0:1787790820.687854:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074368 00000100:00100000:2.0:1787790820.687884:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268074240 00000100:00100000:2.0:1787790820.687887:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268074240 00000100:00100000:2.0:1787790820.687901:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787790820.687907:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268074368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.687952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268074368:12345-0@lo:400:kworker.0 Request processed in 45us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.687958:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787790820.687969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787790820.687975:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268074240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688007:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268074240:12345-0@lo:400:kworker.0 Request processed in 32us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790820.688013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787790820.688042:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268074240:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688098:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268074368:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688113:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268074880:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268075392:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688134:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268073984:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688146:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268074496:0@lo:400:kworker.0 00000100:00100000:2.0:1787790820.688157:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268075008:0@lo:400:kworker.0 00000100:00100000:0.0:1787790820.692607:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268075648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790820.692749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790820.693157:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268075648 00000100:00100000:3.0:1787790820.693167:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268075648 00000100:00100000:3.0:1787790820.693249:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787790820.693259:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268075648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790820.693309:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790820.693389:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268075648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790820.693397:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787790820.693609:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268075648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790820.761735:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790820.762518:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250162688 00000100:00100000:2.0:1787790820.762530:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250162688 00000100:00100000:2.0:1787790820.762599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787790820.762616:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+33:11158:x1874634250162688:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790820.762651:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790820.762675:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1de3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223be4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.762815:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763098:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763115:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763128:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763136:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763143:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763254:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763263:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763270:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790820.763280:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787790820.763353:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763360:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763383:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763389:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790820.763393:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763401:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763414:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790820.763418:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790820.763422:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763429:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1de41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763444:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763460:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763466:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.763472:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790820.763475:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.766743:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.766768:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:2.0:1787790820.766772:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790820.766779:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.766788:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1de48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.769036:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1de3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.769067:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790820.769078:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790820.769081:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790820.769084:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994800, rc 0) 00000100:00100000:3.0:1787790820.769638:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+35:11158:x1874634250162688:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 7026us (7941us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787790820.769648:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:1.0:1787790820.780644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790820.780861:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250162816 00000100:00100000:3.0:1787790820.781081:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250162816 00000100:00100000:3.0:1787790820.781168:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:3.0:1787790820.781180:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+35:11158:x1874634250162816:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787790820.781650:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.781675:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.781691:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.781822:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.781832:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.781839:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.781847:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790820.782093:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.782104:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.782120:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790820.782124:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790820.782130:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790820.782138:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790820.782379:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+35:11158:x1874634250162816:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 1186us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790820.782390:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:1.0:1787790820.790070:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790820.790166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250163072 00000100:00100000:0.0:1787790820.790180:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250163072 00000100:00100000:0.0:1787790820.790249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:0.0:1787790820.790260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+35:11158:x1874634250163072:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790820.791032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+36:11158:x1874634250163072:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 772us (976us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787790820.791042:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00010000:00010000:2.0:1787790821.195474:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790821.273632:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790821.273947:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250163328 00000100:00100000:0.0:1787790821.273963:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250163328 00000100:00100000:0.0:1787790821.274083:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:0.0:1787790821.274096:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+36:11189:x1874634250163328:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:0.0:1787790821.274141:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790821.274169:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223beb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.274317:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.274358:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.274384:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790821.274399:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787790821.274874:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1de64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223beb expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.274905:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223beb expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.274916:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790821.274920:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790821.274924:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5000, rc 0) 00000100:00100000:0.0:1787790821.275016:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+38:11189:x1874634250163328:12345-192.168.202.22@tcp:101:cat.0 Request processed in 922us (1401us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787790821.275027:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00080000:2.0:1787790821.276033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790821.279605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790821.279930:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250163584 00000100:00100000:2.0:1787790821.279943:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250163584 00000100:00100000:2.0:1787790821.280022:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:2.0:1787790821.280035:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:11189:x1874634250163584:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:2.0:1787790821.280388:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+39:11189:x1874634250163584:12345-192.168.202.22@tcp:35:cat.0 Request processed in 354us (803us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1787790821.280416:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:0.0:1787790821.283283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790821.284384:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250163712 00000100:00100000:2.0:1787790821.284399:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250163712 00000100:00100000:2.0:1787790821.284497:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787790821.284519:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+39:2403:x1874634250163712:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790821.284554:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790821.284589:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1de6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223beb expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.284627:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790821.284633:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790821.284984:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+38:2403:x1874634250163712:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 475us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790821.284995:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:1.0:1787790821.371921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790821.372145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250163968 00000100:00100000:3.0:1787790821.372158:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250163968 00000100:00100000:3.0:1787790821.372311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:3.0:1787790821.372325:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:11195:x1874634250163968:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787790821.372357:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790821.372361:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787790821.372409:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1ddd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bc1 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.372436:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:3.0:1787790821.372443:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790821.372462:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.372638:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.372656:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.372665:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.372771:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.372786:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 38 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790821.372802:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268075776:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790821.372918:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790821.376979:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268075776:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790821.377161:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790821.379110:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790821.384889:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164096 00000100:00100000:0.0:1787790821.384920:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164096 00010000:00010000:0.0:1787790821.384999:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 39 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790821.385062:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:0.0:1787790821.385074:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+39:2402:x1874634250164096:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790821.385112:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790821.385120:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 39 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.385135:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 39 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.385163:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1de4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223be4 expref: 39 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.385181:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790821.385188:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.385198:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.385207:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.385247:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790821.385332:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+38:2402:x1874634250164096:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 260us (6233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790821.385341:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00010000:00010000:3.0:1787790821.385549:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.385559:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790821.385582:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787790821.385818:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1de79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.385835:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.385843:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790821.385847:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790821.385849:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:3.0:1787790821.385884:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:11195:x1874634250163968:12345-192.168.202.22@tcp:101:dd.0 Request processed in 13564us (13998us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787790821.385892:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:1.0:1787790821.390153:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790821.390524:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164224 00000100:00100000:3.0:1787790821.390541:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164224 00000100:00100000:3.0:1787790821.390627:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787790821.390640:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+38:11195:x1874634250164224:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787790821.390672:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790821.390701:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223bf9 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.390789:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.390808:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.390822:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.391363:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 40 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.391449:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 39 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.391461:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790821.391465:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790821.391469:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fc00, rc 0) 00000100:00100000:3.0:1787790821.391675:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+39:11195:x1874634250164224:12345-192.168.202.22@tcp:101:dd.0 Request processed in 1036us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790821.391686:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:2.0:1787790821.398620:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790821.398748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164480 00000100:00100000:3.0:1787790821.398761:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164480 00000100:00100000:3.0:1787790821.398842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:3.0:1787790821.398856:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+39:11195:x1874634250164480:12345-192.168.202.22@tcp:36:dd.0 00010000:00010000:3.0:1787790821.399187:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.399210:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.399224:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790821.399278:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1787790821.399309:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b91a5376 reply state 00000000b77633db transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.399347:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790821.399355:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790821.399359:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790821.399372:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790821.399495:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+42:11195:x1874634250164480:12345-192.168.202.22@tcp:36:dd.0 Request processed in 642us (890us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787790821.399505:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000020:00080000:3.0:1787790821.399511:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787790821.829972:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790821.830017:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790821.830058:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790821.830086:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790821.830108:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790821.830237:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164608 00000100:00100000:2.0:1787790821.830247:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164608 00000100:00100000:2.0:1787790821.830303:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 377 00000100:00100000:2.0:1787790821.830313:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250164608:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790821.830393:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2400:x1874634250164608:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790821.830400:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 377 00000100:00100000:2.0:1787790821.830430:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164864 00000100:00100000:2.0:1787790821.830433:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164864 00000100:00100000:2.0:1787790821.830457:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:2.0:1787790821.830462:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2400:x1874634250164864:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790821.830516:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2400:x1874634250164864:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 43us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790821.830524:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:2.0:1787790821.830542:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164736 00000100:00100000:2.0:1787790821.830545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164736 00000100:00080000:2.0:1787790821.830563:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790821.830583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250164992 00000100:00100000:2.0:1787790821.830585:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250164992 00000100:00080000:2.0:1787790821.830595:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790821.830607:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250165120 00000100:00100000:2.0:1787790821.830610:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250165120 00000100:00080000:2.0:1787790821.830618:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790821.830629:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 263 00000100:00100000:2.0:1787790821.830635:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250164736:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790821.830660:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250164736:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790821.830666:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 263 00000100:00100000:2.0:1787790821.830676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 264 00000100:00100000:2.0:1787790821.830681:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250164992:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790821.830698:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250164992:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 18us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790821.830739:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 264 00000100:00100000:2.0:1787790821.830750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 265 00000100:00100000:2.0:1787790821.830756:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250165120:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790821.830775:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250165120:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 20us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790821.830788:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 265 00000100:00100000:1.0:1787790821.864330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790821.864598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250165248 00000100:00100000:2.0:1787790821.864608:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250165248 00000100:00100000:2.0:1787790821.864672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:2.0:1787790821.864682:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+42:11209:x1874634250165248:12345-192.168.202.22@tcp:101:stat.0 00010000:00010000:2.0:1787790821.864732:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790821.864753:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1dea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c00 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864855:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864872:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864884:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864896:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864904:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864911:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.864981:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.865002:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.865012:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.865045:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790821.865061:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 43 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790821.865086:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268075904:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790821.865332:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790821.872238:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268075904:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790821.872268:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790821.872565:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790821.874766:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250165504 00000100:00100000:0.0:1787790821.874805:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250165504 00000100:00100000:0.0:1787790821.874880:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:0.0:1787790821.874892:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+44:6168:x1874634250165504:12345-192.168.202.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787790821.875262:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+45:6168:x1874634250165504:12345-192.168.202.22@tcp:35:ldlm_bl.0 Request processed in 371us (2697us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787790821.875270:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000001:00080000:3.0:1787790821.885289:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:3.0:1787790821.885330:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787790821.885347:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170c88d1f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787790821.885353:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170d119ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170c88d1480 00000020:00080000:3.0:1787790821.885356:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170d119e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9170fad04600 00000020:00080000:1.0:1787790821.885891:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787790821.886064:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787790821.886075:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790821.886094:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c2c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268076032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787790821.886156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790821.886197:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268076032 00000100:00100000:1.0:1787790821.886203:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268076032 00000100:00100000:1.0:1787790821.886243:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790821.886251:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268076032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787790821.886275:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787790821.886304:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f85e5, atime: 0x6a8f85e5, ctime: 0x6a8f85e5, blocks: 0x8 00010000:00010000:1.0:1787790821.886312:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886329:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1787790821.886333:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790821.886340:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886355:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886391:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886398:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886417:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790821.886521:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1874634268076032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (364us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787790821.886529:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787790821.886553:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790821.886558:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886566:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790821.886571:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886580:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886596:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886605:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1debf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.886626:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790821.886628:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790821.886630:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787790821.886655:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170c2c2d2c0/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787790821.886660:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c2c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268076032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787790821.887489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00010000:00010000:0.0:1787790821.888998:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889013:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889020:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889027:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790821.889032:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889039:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889053:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9170e15d8900) 00010000:00010000:0.0:1787790821.889056:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790821.889060:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889067:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dd4c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889087:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889109:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889114:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889119:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790821.889122:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889129:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889134:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790821.889137:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790821.889140:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889146:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1dd53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889160:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889166:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889172:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889176:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790821.889184:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889191:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889198:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:0.0:1787790821.889200:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790821.889203:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889208:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dd92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889218:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889224:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889230:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889234:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790821.889237:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889241:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889248:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790821.889250:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790821.889256:0:3624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889266:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.889271:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1de9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790821.889385:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250165632 00000100:00100000:3.0:1787790821.889394:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250165632 00010000:00010000:1.0:1787790821.894523:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 14 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790821.894572:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:1.0:1787790821.894583:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+14:2402:x1874634250165632:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790821.894599:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790821.894605:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 14 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.894618:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 14 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.894641:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1de80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf2 expref: 14 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.894658:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:1.0:1787790821.895148:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.895160:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.895181:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790821.895245:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790821.895312:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+13:2402:x1874634250165632:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 730us (7826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790821.895320:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00010000:00010000:0.0:1787790821.898443:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898458:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790821.898536:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787790821.898541:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790821.898587:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898602:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898612:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898618:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898626:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898632:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790821.898636:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898655:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898680:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790821.898683:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790821.898688:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898695:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1deaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898729:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898737:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898742:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898748:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790821.898751:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898756:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898763:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:0.0:1787790821.898765:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790821.898768:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898783:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1deb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898832:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1dea3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c00 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898846:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c00 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790821.898853:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790821.898855:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790821.898858:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995200, rc 0) 00000100:00100000:0.0:1787790821.898926:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+12:11209:x1874634250165248:12345-192.168.202.22@tcp:101:stat.0 Request processed in 34244us (34605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790821.898935:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:1.0:1787790822.024454:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.024609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250165888 00000100:00100000:3.0:1787790822.024619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250165888 00000100:00100000:3.0:1787790822.024803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:3.0:1787790822.024814:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+12:11215:x1874634250165888:12345-192.168.202.22@tcp:36:truncate.0 00010000:00010000:3.0:1787790822.024871:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790822.024895:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1deb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c00 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.024916:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790822.024943:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790822.026108:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.026127:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.026138:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790822.026194:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787790822.026221:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfb31717 reply state 0000000098688d9d transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.026233:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.026240:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790822.026243:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790822.026246:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790822.026378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+14:11215:x1874634250165888:12345-192.168.202.22@tcp:36:truncate.0 Request processed in 1564us (1933us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787790822.026388:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000020:00080000:3.0:1787790822.026393:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790822.218888:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790822.279324:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.279893:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250166016 00000100:00100000:0.0:1787790822.279904:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250166016 00000100:00100000:0.0:1787790822.279990:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:0.0:1787790822.280004:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:11229:x1874634250166016:12345-192.168.202.22@tcp:101:stat.0 00010000:00010000:0.0:1787790822.280038:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790822.280064:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1decd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c07 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280158:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280173:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280251:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280276:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280286:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280296:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280386:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280399:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280408:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790822.280459:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787790822.280465:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790822.280489:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280502:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280512:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280533:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280540:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280549:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790822.280555:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280634:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280651:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790822.280657:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790822.280662:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280670:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ded4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280689:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280696:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280883:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280890:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790822.280898:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280905:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280948:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:0.0:1787790822.280954:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790822.280958:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.280968:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1dedb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.281014:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1decd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 16 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.281142:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 15 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.281154:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790822.281159:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790822.281162:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5400, rc 0) 00000100:00100000:0.0:1787790822.281291:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+15:11229:x1874634250166016:12345-192.168.202.22@tcp:101:stat.0 Request processed in 1291us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790822.281302:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:1.0:1787790822.410429:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.410551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250166272 00000100:00100000:0.0:1787790822.410562:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250166272 00000100:00100000:0.0:1787790822.410622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:0.0:1787790822.410632:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+15:11239:x1874634250166272:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790822.410666:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790822.410695:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c0e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790822.410823:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787790822.410918:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dee9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c0e expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.410933:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:0.0:1787790822.410937:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790822.410942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1dee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c0e expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.410956:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5e00, rc 0) 00000100:00100000:0.0:1787790822.411016:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:11239:x1874634250166272:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 385us (596us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1787790822.411024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:1.0:1787790822.417039:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.417507:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250166528 00000100:00100000:0.0:1787790822.417518:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250166528 00000100:00100000:0.0:1787790822.417591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:0.0:1787790822.417601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+16:11239:x1874634250166528:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790822.417926:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+17:11239:x1874634250166528:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 325us (896us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787790822.417936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:1.0:1787790822.475564:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.484456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250166784 00000100:00100000:3.0:1787790822.484479:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250166784 00000100:00100000:3.0:1787790822.484576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:3.0:1787790822.484589:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+17:11245:x1874634250166784:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:3.0:1787790822.484623:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790822.484652:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1def7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.485252:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.485275:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 18 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.485286:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.485329:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 18 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.485346:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 18 pid: 10093 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790822.485378:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268076160:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790822.486895:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787790822.498656:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.498775:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250166912 00000100:00100000:0.0:1787790822.498787:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250166912 00010000:00010000:0.0:1787790822.498845:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 19 pid: 10093 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790822.498924:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:0.0:1787790822.498938:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c6461050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+19:2402:x1874634250166912:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790822.498963:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790822.498971:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 19 pid: 10093 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.498987:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 19 pid: 10093 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.499017:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790822.499023:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.499035:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.499044:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.499069:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790822.499149:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c6461050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+19:2402:x1874634250166912:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 213us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790822.499157:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00010000:00010000:3.0:1787790822.499569:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1dee2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c07 expref: 18 pid: 10093 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790822.499592:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268076160:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790822.499621:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.499632:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.499652:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790822.499674:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787790822.499925:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1def7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.499942:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.499951:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790822.499954:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790822.499957:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ea00, rc 0) 00000100:00100000:3.0:1787790822.499995:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+18:11245:x1874634250166784:12345-192.168.202.22@tcp:101:bash.0 Request processed in 15409us (24445us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787790822.500002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:1.0:1787790822.502513:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.502622:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250167168 00000100:00100000:0.0:1787790822.502634:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250167168 00000100:00100000:0.0:1787790822.502914:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:0.0:1787790822.502928:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+18:11245:x1874634250167168:12345-192.168.202.22@tcp:36:bash.0 00010000:00010000:0.0:1787790822.503245:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.503265:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.503279:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790822.503336:0:10093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787790822.503370:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002456d0c3 reply state 00000000db8c195a transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.503384:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.503394:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790822.503397:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790822.503401:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790822.503508:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:11245:x1874634250167168:12345-192.168.202.22@tcp:36:bash.0 Request processed in 583us (1008us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787790822.503516:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 68 00000020:00080000:0.0:1787790822.503522:0:10093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787790822.514123:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790822.514241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250167296 00000100:00100000:2.0:1787790822.514254:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250167296 00000100:00100000:2.0:1787790822.514338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:2.0:1787790822.514352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:11245:x1874634250167296:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790822.514394:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790822.514421:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1df13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c1c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.514541:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.514580:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.514592:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.514637:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.514652:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 22 pid: 6514 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790822.514667:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268076288:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790822.516154:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790822.531574:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268076288:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790822.531615:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790822.532521:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790822.534816:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250167424 00000100:00100000:1.0:1787790822.534833:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250167424 00010000:00010000:1.0:1787790822.534896:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 23 pid: 6514 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790822.534947:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:1.0:1787790822.534959:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+23:2403:x1874634250167424:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790822.534980:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790822.534988:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 23 pid: 6514 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790822.535003:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 23 pid: 6514 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790822.535055:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1defe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c15 expref: 23 pid: 6514 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790822.535076:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:1.0:1787790822.535083:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790822.535093:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790822.535102:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790822.535138:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790822.535224:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:2403:x1874634250167424:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 267us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790822.535233:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00010000:00010000:2.0:1787790822.535528:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.535539:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790822.535623:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787790822.535629:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790822.535678:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.535787:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1df13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c1c expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.535806:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c1c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.535815:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790822.535819:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790822.535822:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994600, rc 0) 00000100:00100000:2.0:1787790822.535858:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:11245:x1874634250167296:12345-192.168.202.22@tcp:101:bash.0 Request processed in 21511us (21751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790822.535867:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:1.0:1787790822.553335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790822.553531:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250167680 00000100:00100000:2.0:1787790822.553545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250167680 00000100:00100000:2.0:1787790822.553621:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:2.0:1787790822.553634:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:11245:x1874634250167680:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:2.0:1787790822.553993:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:11245:x1874634250167680:12345-192.168.202.22@tcp:35:bash.0 Request processed in 360us (673us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787790822.554002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:0.0:1787790822.696518:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.696677:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250167936 00000100:00100000:3.0:1787790822.696692:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250167936 00000100:00100000:3.0:1787790822.696809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:3.0:1787790822.696821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc373bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+22:11255:x1874634250167936:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790822.696867:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790822.696897:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790822.697058:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787790822.697197:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c23 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.697239:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:3.0:1787790822.697243:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790822.697250:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c23 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.697267:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:3.0:1787790822.697629:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc373bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+23:11255:x1874634250167936:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 809us (1136us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1787790822.697638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:1.0:1787790822.708465:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.708590:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250168064 00000100:00100000:0.0:1787790822.708603:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250168064 00000100:00100000:0.0:1787790822.708685:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 71 00000100:00100000:0.0:1787790822.708699:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:11255:x1874634250168064:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:0.0:1787790822.708857:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.708880:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.708897:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.708930:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.708938:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.708945:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709062:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709073:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709081:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790822.709143:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709159:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709177:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709185:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709192:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790822.709197:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709207:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709223:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790822.709226:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790822.709233:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709239:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1df2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709255:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709262:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709268:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709274:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790822.709283:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709290:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709298:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8b00) 00010000:00010000:0.0:1787790822.709301:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790822.709304:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709310:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709328:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709335:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709342:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709347:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790822.709350:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709367:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709374:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790822.709377:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790822.709386:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.709392:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1df3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790822.709501:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:11255:x1874634250168064:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 804us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790822.709510:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 71 00000100:00100000:2.0:1787790822.716844:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.716983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250168320 00000100:00100000:0.0:1787790822.717006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250168320 00000100:00100000:0.0:1787790822.717079:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787790822.717091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+23:11255:x1874634250168320:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790822.717405:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+24:11255:x1874634250168320:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 315us (577us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787790822.717414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:1.0:1787790822.758053:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790822.758237:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250168576 00000100:00100000:2.0:1787790822.758250:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250168576 00000100:00100000:2.0:1787790822.758328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:2.0:1787790822.758340:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+24:11258:x1874634250168576:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790822.758381:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790822.758427:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1df44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c2a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758636:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758653:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758668:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758685:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758693:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758700:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758872:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1df59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758883:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1df59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.758891:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1df59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790822.759119:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787790822.759222:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759241:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759247:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759254:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790822.759259:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759268:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759282:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790822.759285:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790822.759290:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759296:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1df4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759312:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759318:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759324:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759329:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790822.759341:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759347:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759368:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff916fc36ffa00) 00010000:00010000:2.0:1787790822.759371:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790822.759374:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759380:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759428:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1df44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c2a expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759443:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1df59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c2a expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.759450:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790822.759453:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790822.759455:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995e00, rc 0) 00000100:00100000:2.0:1787790822.759752:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+26:11258:x1874634250168576:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1367us (1667us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787790822.759762:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:1.0:1787790822.763417:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.763564:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250168704 00000100:00100000:3.0:1787790822.763577:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250168704 00000100:00100000:3.0:1787790822.763652:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 73 00000100:00100000:3.0:1787790822.763665:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+26:11258:x1874634250168704:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787790822.764194:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764218:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764233:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764279:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764286:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764314:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764321:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790822.764325:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764334:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764348:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790822.764363:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790822.764369:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.764376:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790822.764517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+26:11258:x1874634250168704:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 853us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790822.764527:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 73 00000100:00100000:1.0:1787790822.767273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.767808:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250168832 00000100:00100000:3.0:1787790822.767822:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250168832 00000100:00100000:3.0:1787790822.767924:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787790822.767937:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+26:2401:x1874634250168832:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790822.767957:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790822.767988:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1df59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c2a expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.768340:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790822.768347:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790822.768432:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+25:2401:x1874634250168832:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 496us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790822.768440:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:0.0:1787790822.777116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790822.779949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250169088 00000100:00100000:2.0:1787790822.779971:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250169088 00000100:00100000:2.0:1787790822.780154:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:2.0:1787790822.780168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+25:11258:x1874634250169088:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790822.780545:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+26:11258:x1874634250169088:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 379us (3442us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787790822.780556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787790822.920362:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.920475:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250169344 00000100:00100000:3.0:1787790822.920489:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250169344 00000100:00100000:3.0:1787790822.920586:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 74 00000100:00100000:3.0:1787790822.920601:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+26:11276:x1874634250169344:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:3.0:1787790822.920635:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790822.920664:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c31 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.920859:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1df75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.920879:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1df75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.920893:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1df75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790822.920907:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787790822.921052:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1df6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c31 expref: 29 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.921078:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1df75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c31 expref: 28 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790822.921106:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790822.921109:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787790822.921114:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ea00, rc 0) 00000100:00100000:3.0:1787790822.921192:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+28:11276:x1874634250169344:12345-192.168.202.22@tcp:101:cat.0 Request processed in 594us (853us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787790822.921201:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 74 00000100:00100000:1.0:1787790822.951135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790822.951397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250169472 00000100:00100000:2.0:1787790822.951411:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250169472 00000100:00100000:2.0:1787790822.951502:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:2.0:1787790822.951516:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+28:11277:x1874634250169472:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790822.951549:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790822.951579:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1df83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c38 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.951668:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.951687:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.951702:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790822.951810:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787790822.951814:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790822.951838:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.951885:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1df83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c38 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.951908:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c38 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.951938:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790822.951942:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790822.951947:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994a00, rc 0) 00000100:00100000:2.0:1787790822.952037:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+29:11277:x1874634250169472:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 525us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790822.952045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:1.0:1787790822.960517:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790822.960627:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250169856 00000100:00100000:3.0:1787790822.960640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250169856 00000100:00100000:3.0:1787790822.960763:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787790822.960776:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:11277:x1874634250169856:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:3.0:1787790822.961176:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+30:11277:x1874634250169856:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 401us (681us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787790822.961186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:1.0:1787790822.964254:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790822.964391:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250169984 00000100:00100000:2.0:1787790822.964406:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250169984 00000100:00100000:2.0:1787790822.964505:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:2.0:1787790822.964519:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+30:11277:x1874634250169984:12345-192.168.202.22@tcp:103:lfs.0 00010000:00010000:2.0:1787790822.964542:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787790822.964579:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c1c expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.964611:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1df75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c31 expref: 29 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.964625:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1de10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bd6 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790822.964637:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790822.964643:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790822.964771:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+27:11277:x1874634250169984:12345-192.168.202.22@tcp:103:lfs.0 Request processed in 255us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790822.964780:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787790822.969299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790822.969508:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250170112 00000100:00100000:0.0:1787790822.969521:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250170112 00000100:00100000:0.0:1787790822.969594:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 76 00000100:00100000:0.0:1787790822.969605:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+27:11277:x1874634250170112:12345-192.168.202.22@tcp:58:lfs.0 00010000:00010000:0.0:1787790822.969813:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.969835:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790822.970090:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790822.970434:0:10093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790822.971099:0:10093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787790822.971215:0:10093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787790822.971330:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+27:11277:x1874634250170112:12345-192.168.202.22@tcp:58:lfs.0 Request processed in 1721us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790822.971343:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 76 00000100:00100000:0.0:1787790822.999803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790823.000086:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250170240 00000100:00100000:2.0:1787790823.000101:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250170240 00000100:00100000:2.0:1787790823.000180:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 77 00000100:00100000:2.0:1787790823.000201:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:11279:x1874634250170240:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790823.000230:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790823.000259:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1df98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c3f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000359:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000380:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000394:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000413:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000420:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000427:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000626:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000639:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000671:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790823.000809:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787790823.000815:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790823.000839:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000866:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000876:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000884:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000892:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000898:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790823.000903:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000912:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000926:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790823.000930:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790823.000936:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000955:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1df9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000971:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000978:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.000984:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001170:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790823.001176:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001183:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001237:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff916fc36ffa00) 00010000:00010000:2.0:1787790823.001241:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790823.001245:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001251:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1dfa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001292:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1df98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001306:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.001320:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790823.001323:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790823.001325:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995000, rc 0) 00000100:00100000:2.0:1787790823.001469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+28:11279:x1874634250170240:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1278us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790823.001480:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 77 00000100:00100000:0.0:1787790823.244641:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790823.244678:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268076416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790823.244807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790823.244897:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268076416 00000100:00100000:0.0:1787790823.244908:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268076416 00000100:00100000:0.0:1787790823.245014:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787790823.245028:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268076416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790823.245071:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790823.245410:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268076416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 385us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790823.245419:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787790823.245447:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790823.245513:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268076416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787790823.245778:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790823.247356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790823.247402:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268076544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790823.247488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790823.251551:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268076544 00000100:00100000:0.0:1787790823.251571:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268076544 00000100:00100000:0.0:1787790823.251734:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787790823.251747:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268076544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790823.251782:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790823.251909:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268076544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (4421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790823.251937:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787790823.252698:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268076544:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787790823.252936:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787790823.434957:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790823.434972:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790823.435270:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787790823.435282:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790823.435649:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268076672:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790823.436199:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790823.450820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.450866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250170368 00000100:00100000:1.0:1787790823.450881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250170368 00000100:00100000:1.0:1787790823.450970:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:1.0:1787790823.450982:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250170368:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790823.451044:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790823.451215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250170368:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 235us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.451224:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00080000:1.0:1787790823.451252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790823.452169:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268076672:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787790823.467830:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.468009:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250170496 00000100:00100000:0.0:1787790823.468025:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250170496 00000100:00100000:0.0:1787790823.468115:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 79 00000100:00100000:0.0:1787790823.468128:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+28:11291:x1874634250170496:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787790823.468228:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468250:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468263:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468443:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468468:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468481:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468521:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468530:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468537:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790823.468619:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787790823.468624:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790823.468638:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468650:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468657:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468663:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468669:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.468674:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468682:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468694:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:0.0:1787790823.468697:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790823.468702:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468936:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468954:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468972:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468978:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468984:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.468987:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.468993:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469003:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9170e15d8b00) 00010000:00010000:0.0:1787790823.469006:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790823.469009:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469015:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfbb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469031:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469037:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469043:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469048:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.469057:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469289:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469298:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790823.469301:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790823.469304:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.469311:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1dfc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790823.469415:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+28:11291:x1874634250170496:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 1285us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790823.469426:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 79 00000100:00100000:3.0:1787790823.496231:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.506859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250170752 00000100:00100000:0.0:1787790823.506888:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250170752 00000100:00100000:0.0:1787790823.507293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 80 00000100:00100000:0.0:1787790823.507308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+28:11291:x1874634250170752:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790823.507339:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790823.507378:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c46 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507538:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507558:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507598:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790823.507613:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787790823.507746:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507754:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507762:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507768:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.507772:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507781:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507796:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790823.507800:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790823.507805:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507811:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.507877:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfc9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c46 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.509308:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:0.0:1787790823.509318:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790823.509329:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c46 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.509355:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5800, rc 0) 00000100:00100000:0.0:1787790823.509462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250170752:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 2157us (13246us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787790823.509474:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 80 00000100:00100000:3.0:1787790823.514082:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.515010:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250170880 00000100:00100000:1.0:1787790823.515025:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250170880 00000100:00100000:1.0:1787790823.515105:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 81 00000100:00100000:1.0:1787790823.515118:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250170880:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790823.515169:0:10094:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790823.515324:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250170880:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 208us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.515333:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 81 00000100:00100000:1.0:1787790823.534286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.534392:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250171136 00000100:00100000:0.0:1787790823.534406:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250171136 00000100:00100000:0.0:1787790823.534490:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 82 00000100:00100000:0.0:1787790823.534513:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250171136:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790823.534544:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790823.534548:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787790823.534585:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1df8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c38 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.534611:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790823.534618:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790823.534635:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfde lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c4d expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790823.535405:0:10093:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787790823.536169:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfe5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.536207:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.536221:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.536297:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1dfde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c4d expref: 31 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.536316:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c4d expref: 30 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.536326:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8b00) 00010000:00010000:0.0:1787790823.536329:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790823.536333:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5000, rc 0) 00000100:00100000:0.0:1787790823.536446:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+30:11291:x1874634250171136:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1945us (2177us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787790823.540268:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 82 00000100:00100000:3.0:1787790823.554297:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.554433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250171392 00000100:00100000:0.0:1787790823.554446:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250171392 00000100:00100000:0.0:1787790823.554530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 83 00000100:00100000:0.0:1787790823.554541:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+30:11291:x1874634250171392:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790823.554619:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790823.554654:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1dfe5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c4d expref: 30 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554677:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8b00) 00010000:00010000:0.0:1787790823.554721:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790823.554752:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554768:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554780:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554807:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554814:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554820:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554883:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554890:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554898:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554905:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.554910:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554917:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554932:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790823.554935:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790823.554940:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554946:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1dff3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554958:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554964:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554971:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554976:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.554980:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554986:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.554993:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xdc18985 (ffff9170e15d8900) 00010000:00010000:0.0:1787790823.554995:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790823.554999:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.555005:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1dffa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdc18985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790823.555120:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250171392:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 579us (837us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790823.555127:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 83 00000100:00100000:0.0:1787790823.564976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.565022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250171520 00000100:00100000:0.0:1787790823.565035:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250171520 00000100:00100000:0.0:1787790823.565099:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 84 00000100:00100000:0.0:1787790823.565110:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+29:11291:x1874634250171520:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790823.565137:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790823.565167:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e001 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c54 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.565307:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.565326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.565340:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.565688:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e001 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.566645:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.566658:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790823.566673:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790823.566679:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4200, rc 0) 00000100:00100000:0.0:1787790823.567363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+30:11291:x1874634250171520:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1676us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790823.567375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 84 00000100:00100000:0.0:1787790823.572053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790823.573582:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250171776 00000100:00100000:2.0:1787790823.573600:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250171776 00000100:00100000:2.0:1787790823.573684:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 85 00000100:00100000:2.0:1787790823.573697:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+30:11291:x1874634250171776:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790823.573827:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.573851:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.573867:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790823.574119:0:10093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787790823.574131:0:10093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372522425093ns, next at 373522421610ns, rc = 0 00000004:00010000:2.0:1787790823.574192:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064278f7c reply state 0000000037f513fc transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.574208:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.574235:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:2.0:1787790823.574238:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787790823.574243:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790823.574394:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+32:11291:x1874634250171776:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 698us (2354us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787790823.574404:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 85 00000100:00100000:3.0:1787790823.576587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.576768:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250171904 00000100:00100000:1.0:1787790823.576780:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250171904 00000100:00100000:1.0:1787790823.576847:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00100000:1.0:1787790823.576867:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+32:11291:x1874634250171904:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790823.576899:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790823.576925:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c5b expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.576994:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 33 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.577010:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 33 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.577033:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:1.0:1787790823.577037:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790823.577041:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:1.0:1787790823.577107:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+33:11291:x1874634250171904:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 241us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.577113:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00100000:2.0:1787790823.585766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.585922:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250172032 00000100:00100000:3.0:1787790823.585935:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250172032 00000100:00100000:3.0:1787790823.585997:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:3.0:1787790823.586007:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874634250172032:12345-192.168.202.22@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787790823.586056:0:10092:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:3.0:1787790823.586101:0:10092:0:(genops.c:1385:class_connect()) connect: client a61a333f-852a-40de-8207-4f7de209a9a4, cookie 0xcf9477fddcf1e01d 00002000:00100000:3.0:1787790823.586118:0:10092:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a61a333f-852a-40de-8207-4f7de209a9a4/ffff9170c355d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790823.586143:0:10092:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790823.586259:0:10092:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787790823.586298:0:10092:0:(import.c:65:import_set_state_nolock()) ffff9170c355d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790823.586400:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2399:x1874634250172032:12345-192.168.202.22@tcp:8:lhsmtool_posix.0 Request processed in 392us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790823.586410:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:0.0:1787790823.590560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.591534:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250172160 00000100:00100000:1.0:1787790823.591549:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250172160 00000100:00100000:0.0:1787790823.591872:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:0.0:1787790823.591886:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:0:x1874634250172160:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787790823.592107:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787790823.595596:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1787790823.595610:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000100:00100000:0.0:1787790823.598259:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:0:x1874634250172160:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 6362us (7697us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787790823.598275:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:3.0:1787790823.606281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.607551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250172416 00000100:00100000:1.0:1787790823.607570:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250172416 00000100:00100000:1.0:1787790823.607658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:1.0:1787790823.607670:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+33:11291:x1874634250172416:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787790823.607993:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+34:11291:x1874634250172416:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 325us (1730us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787790823.608002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787790823.613875:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.614060:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250172672 00000100:00100000:1.0:1787790823.614077:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250172672 00000100:00100000:1.0:1787790823.614171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 87 00000100:00100000:1.0:1787790823.614184:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+34:11291:x1874634250172672:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790823.614358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+34:11291:x1874634250172672:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 176us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.614367:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 87 00000100:00100000:0.0:1787790823.629366:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790823.629450:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250172800 00000100:00100000:2.0:1787790823.629465:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250172800 00000100:00100000:2.0:1787790823.629543:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 88 00000100:00100000:2.0:1787790823.629555:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+34:11291:x1874634250172800:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790823.629582:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790823.629613:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e024 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c62 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.630247:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e02b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.630268:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e02b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.630282:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e02b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790823.630341:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790823.630377:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e02b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.630412:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e024 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c62 expref: 36 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.630443:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e02b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c62 expref: 35 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.630453:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:2.0:1787790823.630457:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787790823.630461:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995e00, rc 0) 00000100:00100000:2.0:1787790823.630585:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+35:11291:x1874634250172800:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1031us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790823.630594:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 88 00000100:00100000:3.0:1787790823.654772:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.660193:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250172928 00000100:00100000:1.0:1787790823.660217:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250172928 00000100:00100000:1.0:1787790823.660311:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:1.0:1787790823.660324:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250172928:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790823.660359:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790823.660391:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c69 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790823.660428:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85e8, blocks: 0x0 00010000:00010000:1.0:1787790823.660456:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1787790823.660462:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790823.660475:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.660501:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.660519:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:1.0:1787790823.660615:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250172928:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 293us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.660633:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:1.0:1787790823.675324:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.675417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250173184 00000100:00100000:3.0:1787790823.675429:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250173184 00000100:00100000:3.0:1787790823.675535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 89 00000100:00100000:3.0:1787790823.675548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+35:11291:x1874634250173184:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790823.675679:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+35:11291:x1874634250173184:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 133us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790823.675687:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 89 00000100:00100000:0.0:1787790823.683830:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.684093:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250173312 00000100:00100000:3.0:1787790823.684106:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250173312 00000100:00100000:3.0:1787790823.684179:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:3.0:1787790823.684191:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:11291:x1874634250173312:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790823.684215:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790823.684246:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c70 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.684286:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.684296:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790823.684301:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790823.684307:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.684366:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.684383:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.684400:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268076800:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790823.684506:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790823.688111:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268076800:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790823.688157:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.688204:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:3.0:1787790823.688291:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:11291:x1874634250173312:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 4101us (4475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790823.688303:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:0.0:1787790823.691243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790823.692010:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250173440 00000100:00100000:2.0:1787790823.692024:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250173440 00010000:00010000:2.0:1787790823.692074:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.692130:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:2.0:1787790823.692142:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250173440:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790823.692162:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790823.692191:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.692207:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.692238:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c46766f/0xcf9477fddcf1e032 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c69 expref: 7 pid: 8428 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.692272:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790823.692277:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790823.692287:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.692300:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.692361:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.692378:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874634268076928:192.168.202.22@tcp:105: 00000100:00100000:2.0:1787790823.692480:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790823.707447:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790823.708521:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250173568 00000100:00100000:2.0:1787790823.708535:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250173568 00002000:00100000:2.0:1787790823.708600:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff916fc37661c0 x1874634250173568/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:664/0 lens 504/0 e 0 to 0 dl 1787790834 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790823.708614:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc37661c0 with x1874634250173568 ext(0->8) 00002000:00010000:2.0:1787790823.708621:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc37661c0 00000100:00100000:2.0:1787790823.708665:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:2.0:1787790823.708676:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250173568:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787790823.709556:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874634268076928:192.168.202.22@tcp:105: 00010000:00010000:2.0:1787790823.709587:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790823.709761:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+9:2401:x1874634250173440:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 17619us (18528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790823.709774:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:2.0:1787790823.711930:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250173568:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 Request processed in 3248us (4491us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787790823.711947:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00002000:00100000:2.0:1787790823.711963:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff916fc37661c0 x1874634250173568/t4294967303(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:664/0 lens 504/448 e 0 to 0 dl 1787790834 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790823.711973:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc37661c0 with x1874634250173568 ext(0->8) 00002000:00010000:2.0:1787790823.711980:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc37661c0 00000100:00100000:1.0:1787790823.715991:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.716103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250173696 00000100:00100000:3.0:1787790823.716115:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250173696 00000100:00100000:3.0:1787790823.716182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 90 00000100:00100000:3.0:1787790823.716195:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+35:11291:x1874634250173696:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787790823.720680:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1787790823.720696:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787790823.720756:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1787790823.720996:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+17:11291:x1874634250173696:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 4798us (5013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790823.721008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 90 00010000:00010000:2.0:1787790823.721084:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721096:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721105:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721112:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790823.721117:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721125:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721141:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790823.721145:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790823.721152:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721172:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1dec6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721190:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721196:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721202:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721207:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790823.721210:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721216:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721226:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790823.721228:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790823.721231:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721236:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1df0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721248:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721255:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721267:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721272:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790823.721275:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721282:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721291:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:2.0:1787790823.721370:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787790823.721375:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.721381:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e00f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790823.722690:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790823.722729:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268077056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787790823.722811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790823.722893:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268077056 00000100:00100000:2.0:1787790823.722906:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268077056 00000100:00100000:2.0:1787790823.722984:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787790823.722996:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268077056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787790823.723123:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787790823.723126:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787790824 00002000:00010000:2.0:1787790823.723128:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787790823.723130:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787790824 -> 1787790824 00002000:00010000:2.0:1787790823.723131:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787790823.723209:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268077056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (398us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787790823.723223:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1787790823.723244:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170fbdcda40/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787790823.723254:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268077056:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787790823.723595:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1787790823.723610:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787790823.723622:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787790823.726849:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.731551:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250173824 00000100:00100000:0.0:1787790823.731575:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250173824 00000100:00100000:0.0:1787790823.731672:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:0.0:1787790823.731698:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250173824:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787790823.734152:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787790823.734184:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1787790823.734397:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250173824:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 2691us (7544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.734412:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:0.0:1787790823.737280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.737410:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250174080 00000100:00100000:1.0:1787790823.737426:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250174080 00000100:00100000:1.0:1787790823.737491:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 91 00000100:00100000:1.0:1787790823.737502:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:11291:x1874634250174080:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790823.737554:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790823.737579:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e02b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c62 expref: 14 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.737596:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:1.0:1787790823.737601:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790823.737632:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.737648:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.737658:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790823.737824:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094f3cede reply state 000000001acfb7e6 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.737838:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.737845:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:1.0:1787790823.737848:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790823.737851:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790823.738116:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+15:11291:x1874634250174080:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 615us (852us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1787790823.738136:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 91 00000100:00100000:1.0:1787790823.749183:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.749328:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250174208 00000100:00100000:3.0:1787790823.749337:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250174208 00000100:00100000:3.0:1787790823.749699:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:2.0:1787790823.750119:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250174208:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787790823.750384:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787790823.750388:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787790824 -> 1787790823 00002000:00010000:2.0:1787790823.750391:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787790821 00002000:00010000:2.0:1787790823.750393:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787790824 -> 1787790823 00002000:00010000:2.0:1787790823.750396:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787790823.750505:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250174208:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 730us (1330us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787790823.750514:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:0.0:1787790823.756867:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790823.758154:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250174464 00000100:00100000:2.0:1787790823.758165:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250174464 00000100:00100000:2.0:1787790823.758213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 92 00000100:00100000:2.0:1787790823.758223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+15:11291:x1874634250174464:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787790823.758287:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.758304:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.758314:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.758358:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.758381:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 15 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.758392:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268077184:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790823.758516:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790823.763862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790823.763895:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250174592 00000100:00100000:1.0:1787790823.763903:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250174592 00010000:00010000:1.0:1787790823.763939:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 16 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790823.763973:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:1.0:1787790823.763982:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:2402:x1874634250174592:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790823.763996:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790823.764002:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 16 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.764016:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 16 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.764051:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:1.0:1787790823.764057:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.764077:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.764085:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790823.764104:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790823.764227:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:2402:x1874634250174592:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 178us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790823.764237:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00010000:00010000:3.0:1787790823.766655:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e008 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c54 expref: 15 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.766682:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268077184:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790823.766701:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766722:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766733:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766766:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766770:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766775:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766778:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790823.766782:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766786:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766798:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:3.0:1787790823.766800:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787790823.766803:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.766807:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e047 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.766879:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+14:11291:x1874634250174464:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 Request processed in 8658us (10019us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787790823.766886:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 92 00000100:00100000:1.0:1787790823.775929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.776494:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250174720 00000100:00100000:3.0:1787790823.776503:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250174720 00000100:00100000:3.0:1787790823.776558:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:3.0:1787790823.776568:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250174720:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787790823.776614:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.776632:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.776638:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790823.776641:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790823.776645:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.776676:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.776686:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 7 pid: 8427 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.776697:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268077312:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790823.777774:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790823.788948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790823.789028:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250174848 00000100:00100000:0.0:1787790823.789036:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250174848 00010000:00010000:0.0:1787790823.789074:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 8 pid: 8427 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790823.789106:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:0.0:1787790823.789116:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250174848:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790823.789131:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790823.789247:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 8 pid: 8427 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.789258:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 8 pid: 8427 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.789278:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790823.789282:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790823.789286:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.789304:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.789325:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790823.789422:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250174848:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 307us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790823.789445:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00010000:00010000:3.0:1787790823.789582:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1e039 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c70 expref: 7 pid: 8427 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.789598:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268077312:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790823.789628:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789638:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789645:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789662:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789669:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789676:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789682:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790823.789686:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789695:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789745:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.789770:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e04e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790823.790908:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250174720:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 14337us (14984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790823.790919:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:1.0:1787790823.792834:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.792872:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250175104 00000100:00100000:3.0:1787790823.792880:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250175104 00000100:00100000:3.0:1787790823.792934:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 93 00000100:00100000:3.0:1787790823.792943:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+14:11291:x1874634250175104:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787790823.793110:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.793124:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.793131:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.793203:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.793213:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 14 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.793223:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268077440:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790823.793283:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790823.799353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.799448:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268077440:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790823.799475:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.799649:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250175232 00000100:00100000:2.0:1787790823.799657:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250175232 00010000:00010000:2.0:1787790823.799953:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.799999:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:2.0:1787790823.800010:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c6460450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+15:2403:x1874634250175232:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790823.800024:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790823.800030:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.800042:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.800065:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1de95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223bf9 expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.800079:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:2.0:1787790823.800087:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.800109:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.800116:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.800143:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790823.800200:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c6460450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+14:2403:x1874634250175232:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 191us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790823.800208:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00010000:00010000:3.0:1787790823.801993:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.802008:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.802190:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.802206:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.802214:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.802251:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.802266:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 14 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.802279:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268077568:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790823.802418:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790823.807692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.807980:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268077568:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790823.808003:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.809163:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250175360 00000100:00100000:2.0:1787790823.809172:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250175360 00010000:00010000:2.0:1787790823.809214:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.809253:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:2.0:1787790823.809264:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+15:2402:x1874634250175360:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790823.809280:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790823.809287:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.809310:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.809333:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e016 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c5b expref: 15 pid: 10094 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.809377:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:2.0:1787790823.809383:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.809392:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.809400:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790823.809427:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790823.809458:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.809472:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790823.809489:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+14:2402:x1874634250175360:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 227us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790823.809498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000001:00080000:3.0:1787790823.809576:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787790823.809698:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787790823.809761:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787790823.809828:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874634268077696:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787790823.809873:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790823.809894:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790823.812378:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268077696 00000100:00100000:2.0:1787790823.812395:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268077696 00000100:00100000:2.0:1787790823.812459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787790823.812470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1874634268077696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787790823.812599:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1874634268077696:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790823.812606:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787790823.813561:0:6513:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787790823.813569:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170fbdcda40, transno 4294967304 00000100:00100000:3.0:1787790823.813585:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c8278000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874634268077696:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787790823.816454:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1787790823.816567:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874634268077824:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787790823.816642:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790823.816692:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787790823.817246:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268077824 00000100:00100000:3.0:1787790823.817254:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268077824 00000100:00100000:3.0:1787790823.817313:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787790823.817325:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1874634268077824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787790823.817485:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1874634268077824:12345-0@lo:1000:mdt00_001.0 Request processed in 162us (843us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787790823.817493:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787790823.817658:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874634268077824:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787790823.817748:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.817759:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.817767:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.817774:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.817779:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.817787:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.817804:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790823.817807:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790823.817812:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.817818:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e05c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818279:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818301:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818307:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818313:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790823.818316:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818323:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818332:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:0.0:1787790823.818334:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790823.818338:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818353:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1df91 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818378:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818392:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818401:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818432:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.818453:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 17 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790823.818467:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268077952:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790823.818544:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787790823.832750:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268077952:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790823.832790:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790823.835408:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.835608:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250175488 00000100:00100000:3.0:1787790823.835618:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250175488 00010000:00010000:3.0:1787790823.835662:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 18 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.835761:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:3.0:1787790823.835774:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:2403:x1874634250175488:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790823.835790:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790823.835798:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 18 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.835812:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 18 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.835835:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1dfad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c3f expref: 18 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.835851:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790823.835857:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.835868:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.835876:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.835905:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790823.835963:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+17:2403:x1874634250175488:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 192us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790823.835971:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00010000:00010000:3.0:1787790823.836445:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836461:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836474:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836480:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836497:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836503:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790823.836508:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836515:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836526:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790823.836529:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790823.836533:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836539:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e063 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836551:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836557:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836568:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836574:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165e800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790823.836577:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836584:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836593:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc36ff700) 00010000:00010000:3.0:1787790823.836596:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790823.836599:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.836606:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e055 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.836768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:11291:x1874634250175104:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 43824us (43938us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787790823.836779:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 93 00000020:00080000:3.0:1787790823.836783:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787790823.836873:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790823.836879:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790823.836907:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787790823.836927:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790823.845023:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790823.845249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250175744 00000100:00100000:3.0:1787790823.845261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250175744 00000100:00100000:3.0:1787790823.845355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:3.0:1787790823.845368:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:11291:x1874634250175744:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787790823.845658:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787790823.845692:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787790823.845757:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.845773:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.845783:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.845792:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.845798:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.845803:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790823.845822:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790823.845889:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790823.845897:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.845905:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790823.845910:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.845916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:11291:x1874634250175744:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 550us (902us total) trans 4294967364 rc 0/0 00010000:00010000:0.0:1787790823.845921:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790823.845930:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000020:00080000:3.0:1787790823.845937:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787790823.845941:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790823.845946:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787790823.845950:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.845957:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e06a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790823.845971:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790823.845973:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790823.845975:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787790823.961891:0:14200:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790823.961901:0:14200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790823.961924:0:14200:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787790823.961932:0:14200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790824.096929:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.097250:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250176000 00000100:00100000:0.0:1787790824.097266:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250176000 00000100:00100000:0.0:1787790824.097329:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 94 00000100:00100000:0.0:1787790824.097349:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+18:11301:x1874634250176000:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790824.097371:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790824.097391:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c77 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.097567:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1e078 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.097581:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1e078 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.097595:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1e078 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790824.097606:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787790824.097702:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c77 expref: 21 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.097748:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1e078 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c77 expref: 20 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.097757:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790824.097760:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790824.097764:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5400, rc 0) 00000100:00100000:0.0:1787790824.097820:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+20:11301:x1874634250176000:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 481us (911us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787790824.097828:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 94 00000100:00100000:3.0:1787790824.104942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.105038:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250176128 00000100:00100000:0.0:1787790824.105048:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250176128 00000100:00100000:0.0:1787790824.105110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 95 00000100:00100000:0.0:1787790824.105120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c8278b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+20:11301:x1874634250176128:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:0.0:1787790824.105209:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105226:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105237:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105253:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105260:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105266:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105360:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105368:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105376:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790824.105419:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105441:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105446:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105621:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105629:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790824.105633:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105640:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105652:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790824.105655:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790824.105660:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105666:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e086 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105681:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105687:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105693:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105728:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790824.105732:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105738:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105747:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170e15d8100) 00010000:00010000:0.0:1787790824.105749:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790824.105752:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105757:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e08d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105771:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105777:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105781:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105785:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790824.105788:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105793:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105810:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9170e15d8300) 00010000:00010000:0.0:1787790824.105812:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790824.105815:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.105820:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e094 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.105895:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c8278b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+20:11301:x1874634250176128:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 774us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790824.105904:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 95 00000100:00100000:0.0:1787790824.169393:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.169467:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250176384 00000100:00100000:2.0:1787790824.169477:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250176384 00000100:00100000:2.0:1787790824.169538:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:2.0:1787790824.169549:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+20:11304:x1874634250176384:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790824.169569:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790824.169589:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e09b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c7e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169662:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169677:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169688:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169701:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169775:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169782:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169915:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169925:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.169933:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790824.169941:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787790824.170132:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170207:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170216:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170222:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.170225:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170233:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170246:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790824.170249:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.170253:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170271:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e0a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170360:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170366:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170372:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170377:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.170380:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170386:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170394:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff916fc3701000) 00010000:00010000:2.0:1787790824.170397:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.170400:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170406:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e0a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170445:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e09b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170459:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.170474:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:2.0:1787790824.170476:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790824.170479:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994400, rc 0) 00000100:00100000:2.0:1787790824.170548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:11304:x1874634250176384:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1001us (1285us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787790824.170557:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:0.0:1787790824.181853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.181989:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250176512 00000100:00100000:2.0:1787790824.182000:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250176512 00000100:00100000:2.0:1787790824.182059:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 97 00000100:00100000:2.0:1787790824.182069:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+22:11304:x1874634250176512:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:2.0:1787790824.182132:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182149:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182161:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182195:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182203:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182210:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182216:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.182228:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182236:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182315:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:2.0:1787790824.182319:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790824.182325:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.182332:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790824.182412:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+22:11304:x1874634250176512:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 344us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790824.182420:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 97 00000100:00100000:3.0:1787790824.185652:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.190911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250176768 00000100:00100000:0.0:1787790824.190997:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250176768 00000100:00100000:2.0:1787790824.191106:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:2.0:1787790824.191117:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:11304:x1874634250176768:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790824.191360:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:11304:x1874634250176768:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 243us (5714us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787790824.191367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:1.0:1787790824.267582:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.267599:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790824.267614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177024 00000100:00100000:0.0:1787790824.267618:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268078080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790824.267621:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177024 00000100:00100000:1.0:1787790824.267668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 98 00000100:00100000:1.0:1787790824.267677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:10829:x1874634250177024:12345-192.168.202.22@tcp:101:bash.0 00000100:00100000:0.0:1787790824.267680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790824.267699:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787790824.267733:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268078080 00010000:00010000:1.0:1787790824.267734:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e0c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c85 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.267747:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268078080 00000100:00100000:0.0:1787790824.267776:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787790824.267783:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268078080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790824.267803:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787790824.267848:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268078080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790824.267853:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.267855:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00010000:1.0:1787790824.267868:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.267876:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.267898:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268078080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787790824.267901:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.267914:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 24 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790824.267925:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268078208:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790824.268110:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c55b0f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787790824.268251:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790824.268379:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790824.268389:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268078336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790824.268420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790824.268546:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268078336 00000100:00100000:2.0:1787790824.268553:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268078336 00000100:00100000:2.0:1787790824.268588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787790824.268596:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268078336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790824.268616:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790824.268657:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268078336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790824.268673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787790824.268957:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268078336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790824.271205:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268078208:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790824.271236:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790824.273542:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.273627:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177152 00000100:00100000:0.0:1787790824.273636:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177152 00010000:00010000:0.0:1787790824.273689:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.273768:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:0.0:1787790824.273779:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+25:2403:x1874634250177152:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790824.273794:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790824.273800:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.273814:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.273835:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e0b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c7e expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.273853:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:0.0:1787790824.273859:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.273868:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.273889:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.273930:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790824.273982:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+24:2403:x1874634250177152:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 204us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790824.273990:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00010000:00010000:1.0:1787790824.274011:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.274018:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790824.274037:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787790824.274166:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e0c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.274181:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.274195:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:1.0:1787790824.274198:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787790824.274200:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbe00, rc 0) 00000100:00100000:1.0:1787790824.274237:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+24:10829:x1874634250177024:12345-192.168.202.22@tcp:101:bash.0 Request processed in 6561us (6663us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787790824.274244:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 98 00000100:00100000:1.0:1787790824.279431:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.279501:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177280 00000100:00100000:0.0:1787790824.279511:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177280 00000100:00100000:0.0:1787790824.279575:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 99 00000100:00100000:0.0:1787790824.279585:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+24:10829:x1874634250177280:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790824.279610:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790824.279629:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e0da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c8c expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.279662:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e0e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.279677:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.279688:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.279836:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e0da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c8c expref: 26 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.279855:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c8c expref: 25 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.279872:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:0.0:1787790824.279875:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790824.279879:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5800, rc 0) 00000100:00100000:0.0:1787790824.280063:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+25:10829:x1874634250177280:12345-192.168.202.22@tcp:101:bash.0 Request processed in 479us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790824.280071:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 99 00000100:00100000:0.0:1787790824.288696:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.288969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177536 00000100:00100000:3.0:1787790824.288991:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177536 00000100:00100000:3.0:1787790824.289048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 100 00000100:00100000:3.0:1787790824.289057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+25:10829:x1874634250177536:12345-192.168.202.22@tcp:36:bash.0 00010000:00010000:3.0:1787790824.289436:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.289453:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.289464:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790824.289507:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787790824.289531:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000697ad1f6 reply state 000000009ecfef05 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.289543:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.289550:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:3.0:1787790824.289553:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790824.289557:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787790824.289594:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787790824.289697:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+29:10829:x1874634250177536:12345-192.168.202.22@tcp:36:bash.0 Request processed in 639us (1009us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787790824.289731:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 100 00000020:00080000:3.0:1787790824.289736:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787790824.293189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.293627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177664 00000100:00100000:3.0:1787790824.293637:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177664 00000100:00100000:3.0:1787790824.293699:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 101 00000100:00100000:3.0:1787790824.293738:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:10829:x1874634250177664:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:3.0:1787790824.293775:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790824.293795:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e0ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c93 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.293873:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e0ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c93 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.293887:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e0ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c93 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.293905:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:3.0:1787790824.293908:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790824.293911:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:3.0:1787790824.293964:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+30:10829:x1874634250177664:12345-192.168.202.22@tcp:101:bash.0 Request processed in 229us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790824.293971:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 101 00000100:00100000:1.0:1787790824.298540:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.298755:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177792 00000100:00100000:0.0:1787790824.298765:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177792 00000100:00100000:0.0:1787790824.298824:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:0.0:1787790824.298834:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:10829:x1874634250177792:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790824.298853:0:10092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790824.298875:0:10092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223c9a expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790824.298900:0:10092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f85e7, atime: 0x6a8f85e5, ctime: 0x6a8f85e7, blocks: 0x8 00010000:00010000:0.0:1787790824.298921:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1787790824.298926:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790824.298935:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 7 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.298952:0:10092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 7 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.298965:0:10092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4800, rc 0) 00000100:00100000:0.0:1787790824.299045:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:10829:x1874634250177792:12345-192.168.202.22@tcp:101:bash.0 Request processed in 212us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790824.299052:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:1.0:1787790824.302831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.302967:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250177920 00000100:00100000:2.0:1787790824.302986:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250177920 00002000:00010000:2.0:1787790824.303027:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787790824.303032:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc3b93840 with x1874634250177920 ext(0->18446744073709551615) 00002000:00010000:2.0:1787790824.303045:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc3b93840. 00000100:00100000:2.0:1787790824.303083:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787790824.303093:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250177920:12345-192.168.202.22@tcp:10:bash.0 00002000:00010000:2.0:1787790824.303371:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787790824.303375:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787790823 -> 1787790825 00002000:00010000:2.0:1787790824.303378:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787790821 -> 1787790821 00002000:00010000:2.0:1787790824.303380:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787790823 -> 1787790825 00002000:00010000:2.0:1787790824.303383:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787790824.303486:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250177920:12345-192.168.202.22@tcp:10:bash.0 Request processed in 393us (664us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787790824.303494:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00002000:00010000:2.0:1787790824.303503:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787790824.303506:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc3b93840 with x1874634250177920 ext(0->18446744073709551615) 00002000:00010000:2.0:1787790824.303511:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc3b93840. 00000100:00100000:1.0:1787790824.377255:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.377379:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250178048 00000100:00100000:2.0:1787790824.377388:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250178048 00000100:00100000:2.0:1787790824.377482:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:2.0:1787790824.377493:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+30:11318:x1874634250178048:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:2.0:1787790824.377615:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377691:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377701:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377734:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377740:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377744:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377811:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377821:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.377828:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790824.378460:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378474:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378480:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378504:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378508:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.378511:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378518:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378530:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790824.378533:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.378538:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378544:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e0fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378557:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378562:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378568:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378574:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.378577:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378593:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378601:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff916fc3701000) 00010000:00010000:2.0:1787790824.378604:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.378607:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378613:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e104 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378629:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378634:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378640:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378645:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.378648:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378654:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378660:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:2.0:1787790824.378662:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.378665:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.378680:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e10b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790824.379467:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+30:11318:x1874634250178048:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 1970us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790824.379479:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:1.0:1787790824.433796:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.433917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250178304 00000100:00100000:3.0:1787790824.434182:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250178304 00000100:00100000:3.0:1787790824.434253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 103 00000100:00100000:3.0:1787790824.434264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+30:11321:x1874634250178304:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790824.434669:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790824.434693:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ca1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.434863:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.434878:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.434904:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.434923:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.434930:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.434937:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435210:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e127 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435220:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435227:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790824.435236:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787790824.435438:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435446:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435453:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435459:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fc00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790824.435470:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435478:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435555:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:3.0:1787790824.435558:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790824.435563:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435570:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e119 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435585:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435591:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435597:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435603:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165e800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790824.435605:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435611:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435618:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:3.0:1787790824.435620:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790824.435629:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435636:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e120 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435680:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e112 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ca1 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435695:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e127 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ca1 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.435970:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:3.0:1787790824.435974:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787790824.435985:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e0e00, rc 0) 00000100:00100000:3.0:1787790824.436426:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+32:11321:x1874634250178304:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 2163us (2639us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787790824.436435:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 103 00000100:00100000:1.0:1787790824.440490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.440746:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250178432 00000100:00100000:0.0:1787790824.440756:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250178432 00000100:00100000:0.0:1787790824.441190:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 104 00000100:00100000:0.0:1787790824.441202:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+32:11321:x1874634250178432:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:0.0:1787790824.441270:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.441479:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.441550:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.441587:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.441601:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 32 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.441615:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268078464:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790824.441699:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790824.453576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.453751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250178688 00000100:00100000:3.0:1787790824.453760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250178688 00000100:00100000:1.0:1787790824.453856:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e1680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268078464:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790824.453884:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790824.454238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:3.0:1787790824.454251:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+33:6168:x1874634250178688:12345-192.168.202.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787790824.455122:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+34:6168:x1874634250178688:12345-192.168.202.22@tcp:35:ldlm_bl.0 Request processed in 871us (1553us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787790824.455132:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:1.0:1787790824.457824:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.458460:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250178816 00000100:00100000:3.0:1787790824.458470:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250178816 00010000:00010000:3.0:1787790824.458515:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 34 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790824.458616:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:3.0:1787790824.458627:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+34:2403:x1874634250178816:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790824.458643:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790824.458651:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 34 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.458664:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 34 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.458685:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e0cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c85 expref: 34 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.458702:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:3.0:1787790824.459132:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.459143:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.459150:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.459290:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790824.459361:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+33:2403:x1874634250178816:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 734us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790824.459371:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 66 00010000:00010000:1.0:1787790824.459654:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.459663:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.459701:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.460451:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.460460:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.460466:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790824.460471:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.460479:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.460491:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:1.0:1787790824.460494:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790824.460499:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.460505:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e135 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790824.460626:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+32:11321:x1874634250178432:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 19425us (20155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790824.460636:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 104 00000100:00100000:1.0:1787790824.464676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.464866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250179072 00000100:00100000:2.0:1787790824.464876:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250179072 00000100:00100000:2.0:1787790824.464937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:2.0:1787790824.464947:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+32:11321:x1874634250179072:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790824.465666:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+33:11321:x1874634250179072:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 718us (998us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787790824.465676:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:0.0:1787790824.607071:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.607316:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250179328 00000100:00100000:2.0:1787790824.607325:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250179328 00000100:00100000:2.0:1787790824.607412:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 105 00000100:00100000:2.0:1787790824.607422:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+33:11332:x1874634250179328:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:2.0:1787790824.607447:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790824.607468:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e13c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ca8 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.607584:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.607598:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.607620:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.607634:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.607651:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.607658:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.609216:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e151 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.609234:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.609243:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790824.609254:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787790824.610232:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.610244:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.610251:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.610257:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.610763:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.610774:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611071:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790824.611074:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.611173:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611181:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e143 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611198:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611204:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611210:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611214:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.611216:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611222:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611230:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff916fc3701000) 00010000:00010000:2.0:1787790824.611233:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790824.611245:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611250:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e14a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611574:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e13c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ca8 expref: 36 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611593:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e151 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ca8 expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.611601:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:2.0:1787790824.611605:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790824.611607:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994200, rc 0) 00000100:00100000:2.0:1787790824.612019:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+35:11332:x1874634250179328:12345-192.168.202.22@tcp:101:cat.0 Request processed in 4597us (4968us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787790824.612029:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 105 00000100:00100000:0.0:1787790824.622674:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.624094:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250179584 00000100:00100000:3.0:1787790824.624123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250179584 00000100:00100000:3.0:1787790824.624185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:3.0:1787790824.624196:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+35:11332:x1874634250179584:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:3.0:1787790824.624626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+36:11332:x1874634250179584:12345-192.168.202.22@tcp:35:cat.0 Request processed in 429us (1959us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787790824.624635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787790824.696119:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790824.696258:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250179840 00000100:00100000:3.0:1787790824.696269:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250179840 00000100:00100000:3.0:1787790824.696331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 106 00000100:00100000:3.0:1787790824.696352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+36:11333:x1874634250179840:12345-192.168.202.22@tcp:36:rm.0 00010000:00010000:3.0:1787790824.696408:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787790824.696434:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e0ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c93 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696458:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e151 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ca8 expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696472:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e127 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ca1 expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696500:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e0e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c8c expref: 33 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696511:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:3.0:1787790824.696516:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790824.696547:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696573:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696583:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696600:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696608:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696614:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696691:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.696700:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790824.697024:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790824.697423:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787790824.697435:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373645728969ns, next at 374645726564ns, rc = 0 00010000:00010000:2.0:1787790824.697479:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697488:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697496:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697503:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697518:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697523:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697547:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790824.697566:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697573:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697580:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697585:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.697589:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697596:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697606:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:2.0:1787790824.697610:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787790824.697614:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697620:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1e16d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697638:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697646:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790824.697653:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697659:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790824.697660:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697663:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697666:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697670:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697671:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790824.697675:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697679:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00010000:00010000:2.0:1787790824.697680:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697682:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787790824.697685:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697688:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790824.697690:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790824.697691:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e174 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697693:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697699:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e15f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.697702:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790824.697725:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790824.697727:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1787790824.697730:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d238530 reply state 00000000d8f69fb3 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697741:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.697748:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:2.0:1787790824.697750:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787790824.697753:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790824.698938:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+34:11333:x1874634250179840:12345-192.168.202.22@tcp:36:rm.0 Request processed in 2580us (2820us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787790824.698958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 106 00000100:00100000:0.0:1787790824.765645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790824.765777:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250180096 00000100:00100000:1.0:1787790824.765787:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250180096 00000100:00100000:1.0:1787790824.765845:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 107 00000100:00100000:1.0:1787790824.765857:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+34:11339:x1874634250180096:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787790824.765897:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790824.765919:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e17b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223caf expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766027:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766043:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766055:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766066:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766074:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766080:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790824.766430:0:10093:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787790824.766561:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766570:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766577:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766621:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766629:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766635:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766642:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790824.766646:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766654:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766665:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:1.0:1787790824.766668:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790824.766673:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766678:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e182 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790824.766690:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de3da241 reply state 000000000a650f2c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766701:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766754:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:1.0:1787790824.766761:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790824.766764:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787790824.766794:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e17b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 37 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766817:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 36 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.766825:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:1.0:1787790824.766828:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790824.766831:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbe00, rc 0) 00000100:00100000:1.0:1787790824.766906:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+37:11339:x1874634250180096:12345-192.168.202.22@tcp:101:bash.0 Request processed in 1051us (1270us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787790824.766914:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 107 00000100:00100000:0.0:1787790824.771198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790824.771471:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250180224 00000100:00100000:1.0:1787790824.771543:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250180224 00000100:00100000:1.0:1787790824.771671:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:1.0:1787790824.771683:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250180224:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787790824.771729:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790824.771753:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cb6 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790824.771786:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790824.771813:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1787790824.771818:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790824.771829:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.771892:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790824.771910:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa400, rc 0) 00000100:00100000:1.0:1787790824.772191:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250180224:12345-192.168.202.22@tcp:101:bash.0 Request processed in 509us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790824.772200:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00080000:2.0:1787790824.772259:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790824.775211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.775299:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250180352 00000100:00100000:2.0:1787790824.775318:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250180352 00000100:00100000:2.0:1787790824.775399:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:2.0:1787790824.775409:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:11339:x1874634250180352:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790824.775432:0:10092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790824.775454:0:10092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cbd expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.775529:0:10092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.775540:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790824.775545:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790824.775552:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 9 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.775603:0:10092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.775618:0:10092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 9 pid: 8426 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790824.775635:0:10092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10092:1874634268078592:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790824.775778:0:10092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790824.778887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.779030:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250180480 00000100:00100000:0.0:1787790824.779041:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250180480 00010000:00010000:0.0:1787790824.779093:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 10 pid: 8426 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.779142:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:0.0:1787790824.779169:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+10:2402:x1874634250180480:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790824.779188:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790824.779216:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 10 pid: 8426 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.779233:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 10 pid: 8426 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.779264:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790824.779269:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790824.779279:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 10 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.779291:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 10 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.779356:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 10 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.779374:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1874634268078720:192.168.202.22@tcp:105: 00000100:00100000:0.0:1787790824.779473:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790824.781875:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1874634268078720:192.168.202.22@tcp:105: 00010000:00010000:0.0:1787790824.781904:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790824.781962:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+10:2402:x1874634250180480:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 2793us (3087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790824.782001:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 67 00010000:00010000:2.0:1787790824.783130:0:10092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068857806/0xcf9477fddcf1e19e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cb6 expref: 9 pid: 8426 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790824.783157:0:10092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10092:1874634268078592:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790824.783192:0:10092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 8 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.783210:0:10092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994600, rc 0) 00000100:00100000:2.0:1787790824.783273:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:11339:x1874634250180352:12345-192.168.202.22@tcp:101:bash.0 Request processed in 7864us (8074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790824.783282:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:1.0:1787790824.790926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.791002:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250180736 00000100:00100000:2.0:1787790824.791016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250180736 00000100:00100000:2.0:1787790824.791088:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:2.0:1787790824.791101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+37:11339:x1874634250180736:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:2.0:1787790824.791591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:11339:x1874634250180736:12345-192.168.202.22@tcp:35:bash.0 Request processed in 490us (676us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787790824.791601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:0.0:1787790824.964835:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.964955:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250180864 00000100:00100000:2.0:1787790824.964968:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250180864 00000100:00100000:2.0:1787790824.965054:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 108 00000100:00100000:2.0:1787790824.965065:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+38:11355:x1874634250180864:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790824.965104:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790824.965130:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cc4 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.965234:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e1b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.965251:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.965265:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790824.965320:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787790824.965324:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790824.965359:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.965391:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cc4 expref: 40 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.965414:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cc4 expref: 39 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.965423:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790824.965426:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790824.965430:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995e00, rc 0) 00000100:00100000:2.0:1787790824.965512:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+39:11355:x1874634250180864:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 448us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790824.965520:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 108 00000100:00100000:3.0:1787790824.969395:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.969488:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250181120 00000100:00100000:2.0:1787790824.969500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250181120 00000100:00100000:2.0:1787790824.969623:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 109 00000100:00100000:2.0:1787790824.969635:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+39:11355:x1874634250181120:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790824.969660:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790824.969686:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ccb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.969869:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e1c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.969887:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.969901:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790824.969913:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787790824.970052:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ccb expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.970073:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ccb expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.970083:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:2.0:1787790824.970086:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790824.970091:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994800, rc 0) 00000100:00100000:2.0:1787790824.970171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+41:11355:x1874634250181120:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 539us (791us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787790824.970179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 109 00000100:00100000:1.0:1787790824.976951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790824.977042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.977148:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250181504 00000100:00100000:2.0:1787790824.977179:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250181504 00000100:00100000:2.0:1787790824.977265:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 110 00000100:00100000:2.0:1787790824.977277:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+41:11355:x1874634250181504:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790824.977309:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790824.977346:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cd2 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.977481:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e1d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.977499:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.977513:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790824.977527:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787790824.977657:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd2 expref: 44 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.977678:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd2 expref: 43 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.977688:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:2.0:1787790824.977691:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787790824.977695:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995600, rc 0) 00000100:00100000:2.0:1787790824.977783:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+43:11355:x1874634250181504:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 507us (740us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787790824.977791:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 110 00000100:00100000:0.0:1787790824.978295:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250181248 00000100:00100000:0.0:1787790824.978302:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250181248 00000100:00100000:0.0:1787790824.978571:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:0.0:1787790824.978583:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+43:2402:x1874634250181248:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790824.978597:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790824.978617:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e1c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ccb expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.978631:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:0.0:1787790824.978635:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790824.978676:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+42:2402:x1874634250181248:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 98us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790824.978683:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787790824.983047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790824.983137:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250181632 00000100:00100000:0.0:1787790824.983149:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250181632 00000100:00100000:0.0:1787790824.983222:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:0.0:1787790824.983234:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2400:x1874634250181632:12345-192.168.202.22@tcp:1:lfs.0 00010000:00010000:0.0:1787790824.983319:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.983355:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 8 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.983367:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790824.983378:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790824.983383:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.983429:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 8 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790824.983445:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 8 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790824.983463:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1874634268078848:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790824.983615:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790824.993871:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790824.993979:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250181760 00000100:00100000:2.0:1787790824.993991:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250181760 00002000:00100000:2.0:1787790824.994058:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff916fc3b92d00 x1874634250181760/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:665/0 lens 504/0 e 0 to 0 dl 1787790835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790824.994081:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc3b92d00 with x1874634250181760 ext(0->8) 00010000:00010000:2.0:1787790824.994093:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 9 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.994113:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 9 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790824.994123:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc3b92d00 00000100:00100000:2.0:1787790824.994164:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787790824.994174:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250181760:12345-192.168.202.22@tcp:4:lfs.0 00000100:00100000:0.0:1787790824.995766:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1874634268078848:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790824.995813:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790824.999295:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+11:2402:x1874634250181760:12345-192.168.202.22@tcp:4:lfs.0 Request processed in 5105us (5422us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787790824.999315:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00002000:00100000:2.0:1787790824.999343:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff916fc3b92d00 x1874634250181760/t4294967303(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:665/0 lens 504/448 e 0 to 0 dl 1787790835 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790824.999356:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc3b92d00 with x1874634250181760 ext(0->8) 00010000:00010000:2.0:1787790824.999369:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 11 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790824.999395:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 11 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790824.999428:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc3b92d00 00000100:00100000:3.0:1787790825.010939:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790825.014307:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250181888 00000100:00100000:1.0:1787790825.014326:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250181888 00010000:00010000:1.0:1787790825.014417:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 11 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790825.014479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:1.0:1787790825.014490:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+11:2400:x1874634250181888:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790825.014510:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787790825.014533:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790825.014537:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787790826 00002000:00010000:1.0:1787790825.014540:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787790826 00002000:00010000:1.0:1787790825.014542:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787790826 00002000:00010000:1.0:1787790825.014571:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787790825.014579:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 11 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.014597:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 11 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.014628:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005214f1a4/0xcf9477fddcf1e1a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cbd expref: 11 pid: 10092 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.014650:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790825.014656:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790825.014663:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.014675:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.014780:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790825.014859:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:2400:x1874634250181888:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 370us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790825.014868:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 68 00010000:00010000:2.0:1787790825.015579:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015595:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015623:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015632:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015640:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015648:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790825.015654:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015664:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015682:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.015752:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1e1e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.015834:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:2400:x1874634250181632:12345-192.168.202.22@tcp:1:lfs.0 Request processed in 32601us (32801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.015845:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:3.0:1787790825.028439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.029119:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250182144 00000100:00100000:2.0:1787790825.029134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250182144 00000100:00100000:2.0:1787790825.029246:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:2.0:1787790825.029258:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+42:11355:x1874634250182144:12345-192.168.202.22@tcp:35:lfs.0 00000100:00080000:1.0:1787790825.029480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1787790825.029640:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd2 expref: 42 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790825.029978:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787790825.030136:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787790825.030554:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787790825.030600:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.030619:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 46 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.030631:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.030674:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 46 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.030736:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 46 pid: 10093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.030755:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874634268078976:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790825.030875:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790825.034891:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.034984:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250182272 00000100:00100000:3.0:1787790825.034996:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250182272 00010000:00010000:3.0:1787790825.035053:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 47 pid: 10093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.035119:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:3.0:1787790825.035129:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+47:2402:x1874634250182272:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790825.035149:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790825.035156:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 47 pid: 10093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.035171:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 47 pid: 10093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.035200:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:3.0:1787790825.035207:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.035228:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.035237:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.035260:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790825.035330:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+47:2402:x1874634250182272:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 202us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.035346:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00010000:00010000:2.0:1787790825.035701:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e190 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223caf expref: 46 pid: 10093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.035811:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874634268078976:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790825.035839:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.035850:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.035857:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790825.035990:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1787790825.036121:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787790825.036235:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268079104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787790825.036297:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790825.036341:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790825.036411:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268079104 00000100:00100000:0.0:1787790825.036417:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268079104 00000100:00100000:0.0:1787790825.036476:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787790825.036486:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6516:x1874634268079104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787790825.036588:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6516:x1874634268079104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790825.036597:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1787790825.036813:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790825.036989:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268079104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787790825.037144:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787790825.037198:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3797840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268079232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787790825.037264:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.037290:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790825.037860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268079232 00000100:00100000:0.0:1787790825.037867:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268079232 00000100:00100000:0.0:1787790825.037906:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787790825.037915:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874634268079232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787790825.038287:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6516:x1874634268079232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 372us (1020us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787790825.038295:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787790825.038423:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3797840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268079232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787790825.038492:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787790825.038534:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.038545:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.038554:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.038561:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790825.038566:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.038575:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.038592:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:3.0:1787790825.038595:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787790825.038601:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.038609:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e1eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790825.038783:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787790825.038872:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787790825.038887:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373987180870ns, next at 374987177965ns, rc = 0 00000001:00080000:3.0:1787790825.038902:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787790825.038925:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:3.0:1787790825.038928:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787790825.038936:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e1d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd2 expref: 50 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.039053:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+49:11355:x1874634250182144:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 9796us (10628us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787790825.039062:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000020:00080000:3.0:1787790825.039066:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787790825.042966:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.043227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250182400 00000100:00100000:0.0:1787790825.043241:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250182400 00000100:00100000:0.0:1787790825.043316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 111 00000100:00100000:0.0:1787790825.043328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+49:11355:x1874634250182400:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790825.043373:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790825.043405:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e1f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.043483:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd9 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.043500:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd9 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.043521:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790825.043524:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790825.043529:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5a00, rc 0) 00000100:00100000:0.0:1787790825.043603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+50:11355:x1874634250182400:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 276us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790825.043610:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 111 00000100:00100000:0.0:1787790825.054491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.055131:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250182656 00000100:00100000:3.0:1787790825.055143:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250182656 00000100:00100000:3.0:1787790825.055222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:3.0:1787790825.055234:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+50:11355:x1874634250182656:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:3.0:1787790825.055574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+51:11355:x1874634250182656:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 340us (1096us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787790825.055583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:1.0:1787790825.107656:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.107835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250182784 00000100:00100000:2.0:1787790825.107850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250182784 00000100:00100000:2.0:1787790825.107926:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 112 00000100:00100000:2.0:1787790825.107935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+51:11365:x1874634250182784:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:2.0:1787790825.108065:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108083:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108096:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108106:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108113:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108120:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108231:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108241:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108249:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790825.108306:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108319:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108343:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108351:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108359:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790825.108364:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108377:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108393:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790825.108396:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790825.108403:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108409:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e1f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108426:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108432:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108437:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108442:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790825.108453:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108459:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108467:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:2.0:1787790825.108470:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790825.108473:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108479:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e200 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108489:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108495:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108502:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108507:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790825.108510:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108516:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108522:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.108524:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790825.108531:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.108538:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.108853:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+51:11365:x1874634250182784:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 916us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.108862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 112 00000100:00100000:1.0:1787790825.141438:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.141619:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250183040 00000100:00100000:3.0:1787790825.141633:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250183040 00000100:00100000:0.0:1787790825.141965:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 113 00000100:00100000:0.0:1787790825.141983:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+51:11368:x1874634250183040:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790825.142039:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790825.142079:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e20e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ce0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142194:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142214:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142231:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142245:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142254:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142261:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142425:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142434:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142442:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790825.142458:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787790825.142574:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142583:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142590:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142598:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790825.142603:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142612:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142627:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790825.142631:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790825.142636:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142643:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e215 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142661:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142667:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142672:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142677:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790825.142686:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142693:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142701:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:0.0:1787790825.142763:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790825.142767:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142774:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e21c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e20e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142836:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.142844:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790825.142846:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790825.142849:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5200, rc 0) 00000100:00100000:0.0:1787790825.142939:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+53:11368:x1874634250183040:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 963us (1524us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787790825.142949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 113 00000100:00100000:0.0:1787790825.146103:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.146194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250183168 00000100:00100000:3.0:1787790825.146207:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250183168 00000100:00100000:3.0:1787790825.146269:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 114 00000100:00100000:3.0:1787790825.146278:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+53:11368:x1874634250183168:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787790825.146370:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146401:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146439:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146486:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146494:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146501:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146508:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790825.146512:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146520:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146532:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790825.146535:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790825.146541:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.146548:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e231 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.146688:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+53:11368:x1874634250183168:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 411us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.146695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 114 00000100:00100000:1.0:1787790825.152573:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.152654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250183424 00000100:00100000:2.0:1787790825.152668:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250183424 00000100:00100000:2.0:1787790825.152784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787790825.152798:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+53:11368:x1874634250183424:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790825.153109:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+54:11368:x1874634250183424:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 314us (559us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787790825.153119:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:1.0:1787790825.214120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.214502:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250183680 00000100:00100000:2.0:1787790825.214517:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250183680 00000100:00100000:2.0:1787790825.214599:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:2.0:1787790825.214611:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+54:11378:x1874634250183680:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790825.214647:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790825.214652:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787790825.214689:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e1b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cc4 expref: 54 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.214733:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790825.214741:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790825.214759:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e238 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ce7 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.214916:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.214933:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.214944:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.215014:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.215031:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 54 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.215055:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079360:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790825.215173:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790825.217059:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079360:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790825.217092:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790825.217860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.218076:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250183808 00000100:00100000:2.0:1787790825.218086:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250183808 00010000:00010000:2.0:1787790825.218132:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 55 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.218179:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:2.0:1787790825.218206:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+55:2403:x1874634250183808:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790825.218224:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790825.218232:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 55 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.218247:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 55 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.218274:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e223 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce0 expref: 55 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.218295:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.218301:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.218314:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.218323:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.218366:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790825.218438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+54:2403:x1874634250183808:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 234us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.218447:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 70 00010000:00010000:1.0:1787790825.218691:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.218702:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790825.218755:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787790825.218941:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e238 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 55 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.218960:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 54 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.218969:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:1.0:1787790825.218972:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787790825.218975:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994e00, rc 0) 00000100:00100000:1.0:1787790825.219016:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+54:11378:x1874634250183680:12345-192.168.202.22@tcp:101:bash.0 Request processed in 4407us (4911us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787790825.219024:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:0.0:1787790825.234231:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.234471:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250183936 00000100:00100000:2.0:1787790825.234635:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250183936 00000100:00100000:2.0:1787790825.234749:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:2.0:1787790825.234762:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+54:11378:x1874634250183936:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790825.234813:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790825.234840:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e24d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cee expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.234885:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.234903:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.234918:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.235245:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e24d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 56 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.235267:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 55 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.235350:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.235354:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790825.235360:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995200, rc 0) 00000100:00100000:2.0:1787790825.235507:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+55:11378:x1874634250183936:12345-192.168.202.22@tcp:101:bash.0 Request processed in 746us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.235524:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:3.0:1787790825.241456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.241582:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250184192 00000100:00100000:2.0:1787790825.241597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250184192 00000100:00100000:2.0:1787790825.241682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:2.0:1787790825.241695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+55:11378:x1874634250184192:12345-192.168.202.22@tcp:36:bash.0 00010000:00010000:2.0:1787790825.242099:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.242121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.242136:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790825.242183:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1787790825.242206:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069e0da20 reply state 00000000ef3f99ac transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.242221:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.242230:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.242233:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787790825.242238:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790825.242354:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+58:11378:x1874634250184192:12345-192.168.202.22@tcp:36:bash.0 Request processed in 661us (914us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787790825.242363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 117 00000020:00080000:2.0:1787790825.242369:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787790825.249431:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.250755:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250184320 00000100:00100000:2.0:1787790825.250772:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250184320 00000100:00100000:2.0:1787790825.250877:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:2.0:1787790825.250889:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+58:11378:x1874634250184320:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790825.250922:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790825.250947:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e262 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cf5 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.251362:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.251381:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 59 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.251393:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.251439:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 59 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.251456:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 59 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.251473:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079488:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790825.252240:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790825.256686:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079488:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790825.257026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.257176:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250184448 00000100:00100000:3.0:1787790825.257186:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250184448 00010000:00010000:3.0:1787790825.257239:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 60 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.257292:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 71 00000100:00100000:3.0:1787790825.257305:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+60:2402:x1874634250184448:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790825.257324:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790825.257343:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 60 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.257360:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 60 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.257391:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e23f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ce7 expref: 60 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.257411:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790825.257418:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.257429:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.257440:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.257461:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790825.257535:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+59:2402:x1874634250184448:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 232us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.257563:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 71 00010000:00010000:2.0:1787790825.257968:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.257984:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.258241:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790825.258311:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787790825.258325:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790825.258366:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.258408:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e262 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 59 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.258427:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 58 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.258436:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.258440:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790825.258443:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994a00, rc 0) 00000100:00100000:2.0:1787790825.258829:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+58:11378:x1874634250184320:12345-192.168.202.22@tcp:101:bash.0 Request processed in 7940us (9411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.258838:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:1.0:1787790825.263601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.263677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250184704 00000100:00100000:3.0:1787790825.263690:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250184704 00000100:00100000:3.0:1787790825.263807:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787790825.263818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+58:11378:x1874634250184704:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:3.0:1787790825.264117:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+59:11378:x1874634250184704:12345-192.168.202.22@tcp:35:bash.0 Request processed in 300us (529us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787790825.264125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00010000:00010000:0.0:1787790825.292456:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790825.333428:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.335017:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250184832 00000100:00100000:2.0:1787790825.335038:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250184832 00000100:00100000:2.0:1787790825.335128:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:2.0:1787790825.335140:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+59:11384:x1874634250184832:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790825.335173:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790825.335200:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223cfc expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.335284:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.335302:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.335352:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790825.335417:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787790825.335420:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790825.335443:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.335472:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cfc expref: 61 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.335494:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e277 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cfc expref: 60 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.335505:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790825.335508:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790825.335512:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995600, rc 0) 00000100:00100000:2.0:1787790825.336881:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+60:11384:x1874634250184832:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1719us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.336896:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:1.0:1787790825.344544:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.344693:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250184960 00000100:00100000:0.0:1787790825.344751:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250184960 00000100:00100000:0.0:1787790825.344830:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:0.0:1787790825.344844:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+60:11384:x1874634250184960:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790825.344883:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790825.344910:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e27e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345009:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345029:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345043:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345055:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345070:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345160:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345170:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345177:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790825.345241:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787790825.345246:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790825.345268:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345283:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345292:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345300:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345307:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345314:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790825.345319:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345339:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345355:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790825.345358:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790825.345363:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345370:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e285 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345453:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345461:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345467:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345474:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790825.345477:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345484:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345493:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:0.0:1787790825.345496:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790825.345499:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345506:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e28c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345537:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e27e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345552:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.345571:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790825.345574:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790825.345577:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4000, rc 0) 00000100:00100000:0.0:1787790825.345668:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+61:11384:x1874634250184960:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 826us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790825.345677:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:1.0:1787790825.357627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790825.357764:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.357962:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250185344 00000100:00100000:3.0:1787790825.357974:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250185344 00000100:00100000:3.0:1787790825.358056:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:3.0:1787790825.358068:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+61:11384:x1874634250185344:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790825.358094:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790825.358121:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e29a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d0a expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358263:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358283:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358294:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358303:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358362:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358378:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 62 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.358394:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079616:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790825.358522:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.358533:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.358543:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079744:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790825.358567:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c55b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790825.358744:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250185088 00000100:00100000:2.0:1787790825.358750:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250185088 00010000:00010000:2.0:1787790825.358775:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 63 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.358807:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:2.0:1787790825.358815:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+63:2401:x1874634250185088:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790825.358835:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790825.358842:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 63 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.358856:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 63 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.358879:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.358884:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.358892:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.358899:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790825.358924:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+63:2401:x1874634250185088:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 110us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.358932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 72 00010000:00010000:3.0:1787790825.363843:0:10093:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.22@tcp) returned -22 from blocking AST (req@0000000011e4794d x1874634268079616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 62 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.363876:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d03 expref: 62 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.363901:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079616:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790825.365130:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.365463:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250185472 00000100:00100000:2.0:1787790825.365483:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250185472 00010000:00010000:2.0:1787790825.365553:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790825.365896:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268079744:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790825.365943:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790825.365975:0:10093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.365987:0:10093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.365999:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.366113:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 73 00000100:00100000:2.0:1787790825.366126:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+62:2403:x1874634250185472:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790825.366146:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790825.366154:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.366179:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.366212:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e269 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cf5 expref: 62 pid: 10093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.366237:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.366242:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.366251:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.366261:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.366287:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790825.366356:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+61:2403:x1874634250185472:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 232us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.366364:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 73 00010000:00010000:3.0:1787790825.366415:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.366424:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790825.366448:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787790825.366636:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e29a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 62 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.366654:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 61 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.366662:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790825.366665:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790825.366668:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fc00, rc 0) 00000100:00100000:3.0:1787790825.366694:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+61:11384:x1874634250185344:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 8629us (8930us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787790825.366701:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:1.0:1787790825.369472:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.369879:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250185728 00000100:00100000:2.0:1787790825.369891:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250185728 00000100:00100000:2.0:1787790825.369969:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787790825.369981:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+61:11384:x1874634250185728:12345-192.168.202.22@tcp:103:lfs.0 00010000:00010000:2.0:1787790825.370002:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790825.370034:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e1f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cd9 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.370083:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.370090:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790825.370534:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+60:11384:x1874634250185728:12345-192.168.202.22@tcp:103:lfs.0 Request processed in 552us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.370545:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787790825.372491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.372605:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250185856 00000100:00100000:0.0:1787790825.372619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250185856 00000100:00100000:0.0:1787790825.372687:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:0.0:1787790825.372699:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+60:11384:x1874634250185856:12345-192.168.202.22@tcp:58:lfs.0 00010000:00010000:0.0:1787790825.372858:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.372881:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.372897:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790825.373037:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787790825.373134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+60:11384:x1874634250185856:12345-192.168.202.22@tcp:58:lfs.0 Request processed in 436us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790825.373143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:3.0:1787790825.379857:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790825.380161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250185984 00000100:00100000:1.0:1787790825.380176:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250185984 00000100:00100000:1.0:1787790825.380325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:1.0:1787790825.380348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+60:11384:x1874634250185984:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790825.380377:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790825.380406:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d11 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.380490:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.380503:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.380529:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.380544:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.380561:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:1.0:1787790825.380565:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790825.380570:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.380579:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa200, rc 0) 00000100:00100000:1.0:1787790825.382200:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+61:11384:x1874634250185984:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1841us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790825.382215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 123 00000004:00080000:2.0:1787790825.803024:0:9995:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374751314214ns, next at 375751309874ns, rc = 0 00000100:00100000:3.0:1787790825.803207:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790825.803261:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268079872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790825.803380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.803952:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790825.803964:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268080000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790825.803997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804145:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268080128:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804204:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268080640:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804247:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268081152:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804287:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787790825.804292:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268080512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804346:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268081024:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804390:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804422:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080512 00000100:00100000:3.0:1787790825.804431:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080512 00000100:00100000:3.0:1787790825.804482:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787790825.804492:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268080512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804561:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268080512:12345-0@lo:400:kworker.0 Request processed in 70us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.804570:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787790825.804603:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268080256:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804650:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268080768:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804682:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268081280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804745:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787790825.804751:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268080384:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804789:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268080896:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804823:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268081408:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790825.804863:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080384 00000100:00100000:3.0:1787790825.804867:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080384 00000100:00100000:3.0:1787790825.804890:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787790825.804896:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268080384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.804927:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268080384:12345-0@lo:400:kworker.0 Request processed in 32us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.804934:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787790825.804967:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268080512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805004:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268080384:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805027:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080640 00000100:00100000:3.0:1787790825.805029:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080640 00000100:00100000:3.0:1787790825.805049:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080256 00000100:00100000:3.0:1787790825.805051:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080256 00000100:00100000:3.0:1787790825.805060:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080768 00000100:00100000:3.0:1787790825.805062:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080768 00000100:00100000:3.0:1787790825.805090:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268081280 00000100:00100000:3.0:1787790825.805093:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268081280 00000100:00100000:3.0:1787790825.805104:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080896 00000100:00100000:3.0:1787790825.805106:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080896 00000100:00100000:3.0:1787790825.805117:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268081408 00000100:00100000:3.0:1787790825.805119:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268081408 00000100:00100000:3.0:1787790825.805131:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787790825.805137:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268080640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805174:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268080640:12345-0@lo:400:kworker.0 Request processed in 37us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.805181:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787790825.805209:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268080640:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805230:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787790825.805237:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268080256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805250:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268079872 00000100:00100000:2.0:1787790825.805257:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268079872 00000100:00100000:3.0:1787790825.805268:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268080256:12345-0@lo:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.805275:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787790825.805297:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268080256:0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805298:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080000 00000100:00100000:2.0:1787790825.805303:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080000 00000100:00100000:3.0:1787790825.805322:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787790825.805343:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787790825.805348:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268080768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805357:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268079872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790825.805381:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268080768:12345-0@lo:400:kworker.0 Request processed in 36us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.805389:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00002000:00000024:2.0:1787790825.805389:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790825.805409:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268080768:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805434:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787790825.805441:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268081280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805459:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268079872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.805468:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787790825.805482:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268081280:12345-0@lo:400:kworker.0 Request processed in 40us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.805489:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787790825.805492:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790825.805501:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268080000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790825.805510:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00002000:00000024:2.0:1787790825.805514:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787790825.805519:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268080896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805559:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268080896:12345-0@lo:400:kworker.0 Request processed in 42us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.805564:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268080000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.805569:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787790825.805578:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787790825.805587:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787790825.805595:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268081408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805620:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268080000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790825.805627:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268081408:12345-0@lo:400:kworker.0 Request processed in 32us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.805634:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:2.0:1787790825.805662:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4463c00 x1874634268080896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790825.805671:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268081152 00000100:00100000:3.0:1787790825.805676:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268081152 00000100:00100000:2.0:1787790825.805688:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268080896:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805702:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268081024 00010000:00080000:2.0:1787790825.805726:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4460780 x1874634268081408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790825.805729:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268081024 00000100:00100000:2.0:1787790825.805740:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268081408:0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805755:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268081280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805761:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790825.805769:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3639:x1874634268081152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790825.805775:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268079872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790825.805809:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3639:x1874634268081152:12345-0@lo:400:kworker.0 Request processed in 39us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.805817:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787790825.805821:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268081152:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805832:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787790825.805840:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268081024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805867:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268081024:12345-0@lo:400:kworker.0 Request processed in 30us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.805881:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268081024:0@lo:400:kworker.0 00000100:00100000:3.0:1787790825.805885:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787790825.806054:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268080128 00000100:00100000:1.0:1787790825.806059:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268080128 00000100:00100000:1.0:1787790825.806091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787790825.806097:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268080128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790825.806135:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268080128:12345-0@lo:400:kworker.0 Request processed in 39us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790825.806141:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:1.0:1787790825.806179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790825.806183:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790825.806186:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790825.806188:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790825.806205:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268080128:0@lo:400:kworker.0 00000001:00080000:1.0:1787790825.807693:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787790825.807732:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:2.0:1787790825.867670:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790825.867682:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790825.867775:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787790825.868346:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790825.868556:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268081536:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787790825.869682:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790825.872255:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268081536:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790825.872257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.872387:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250186112 00000100:00100000:0.0:1787790825.872397:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250186112 00000100:00100000:0.0:1787790825.872478:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:0.0:1787790825.872492:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+61:11385:x1874634250186112:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787790825.872565:0:10093:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787790825.872740:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+61:11385:x1874634250186112:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 252us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790825.872749:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:1.0:1787790825.876765:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.876897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250186240 00000100:00100000:2.0:1787790825.876910:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250186240 00000100:00100000:2.0:1787790825.876985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:2.0:1787790825.876998:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+61:11385:x1874634250186240:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787790825.877114:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877159:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877174:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877194:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877201:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877208:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877302:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877313:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877322:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790825.877391:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787790825.877396:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790825.877411:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877425:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877442:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877450:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877457:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790825.877462:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877534:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877551:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:2.0:1787790825.877554:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790825.877560:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877567:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e2bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877585:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877591:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877598:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877603:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790825.877613:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877620:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877629:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff916fc3701000) 00010000:00010000:2.0:1787790825.877632:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790825.877635:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877641:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877657:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877663:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877670:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877674:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790825.877677:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877683:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877689:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790825.877692:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790825.877699:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.877894:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790825.877993:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+61:11385:x1874634250186240:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 996us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.878003:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:1.0:1787790825.881304:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.895986:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250186496 00000100:00100000:0.0:1787790825.896008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250186496 00000100:00100000:0.0:1787790825.896119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:0.0:1787790825.896132:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+61:11385:x1874634250186496:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790825.896381:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790825.896420:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e2d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d18 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.896741:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.896762:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.896777:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790825.896792:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787790825.897379:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897391:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897398:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897493:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790825.897503:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897513:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897530:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790825.897534:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787790825.897607:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897616:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5000/0xcf9477fddcf1e2d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897679:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e2d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d18 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897692:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:0.0:1787790825.897695:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790825.897699:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e2d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d18 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790825.897884:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5e00, rc 0) 00000100:00100000:0.0:1787790825.898171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+62:11385:x1874634250186496:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 2039us (16942us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1787790825.898181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:1.0:1787790825.911024:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.911137:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250186624 00000100:00100000:2.0:1787790825.911152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250186624 00000100:00100000:2.0:1787790825.911219:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:2.0:1787790825.911232:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+62:11385:x1874634250186624:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787790825.911286:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787790825.911773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+62:11385:x1874634250186624:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 542us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790825.911784:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:1.0:1787790825.918243:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.918567:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250186880 00000100:00100000:0.0:1787790825.918600:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250186880 00000100:00100000:3.0:1787790825.918839:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:3.0:1787790825.918865:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+62:11385:x1874634250186880:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790825.918897:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790825.918901:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787790825.918937:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e277 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cfc expref: 62 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.918961:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:3.0:1787790825.918976:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790825.919081:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2e7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d1f expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790825.919622:0:10093:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787790825.919837:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.919856:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.919868:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.919963:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e2e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d1f expref: 64 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.919979:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d1f expref: 63 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790825.919988:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc3701000) 00010000:00010000:2.0:1787790825.919991:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790825.919994:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994000, rc 0) 00000100:00100000:2.0:1787790825.920083:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+63:11385:x1874634250186880:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1233us (1855us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787790825.920093:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:1.0:1787790825.925387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.929972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250187136 00000100:00100000:0.0:1787790825.929994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250187136 00000100:00100000:1.0:1787790825.930259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:1.0:1787790825.930273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+63:11385:x1874634250187136:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790825.930368:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790825.930419:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e2ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d1f expref: 63 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.930471:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc3701000) 00010000:00010000:1.0:1787790825.930487:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790825.930518:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931422:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931447:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931851:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931876:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931889:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931946:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931954:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931960:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931966:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790825.931970:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.931992:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932005:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:1.0:1787790825.932009:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790825.932013:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932020:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e2fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932036:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932043:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932050:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932055:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790825.932058:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932065:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932072:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9a7cfdd4 (ffff916fc268fc00) 00010000:00010000:1.0:1787790825.932074:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790825.932077:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.932094:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e303 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9a7cfdd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790825.932469:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+62:11385:x1874634250187136:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 2192us (7090us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790825.932484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:3.0:1787790825.936272:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.945295:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250187264 00000100:00100000:2.0:1787790825.945316:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250187264 00000100:00100000:1.0:1787790825.948486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:1.0:1787790825.948517:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+62:11385:x1874634250187264:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790825.948542:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790825.948634:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e30a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d26 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.948674:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.948687:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.948700:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.950067:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e30a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.950091:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.950101:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:1.0:1787790825.950113:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790825.950117:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa800, rc 0) 00000100:00100000:1.0:1787790825.951918:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+63:11385:x1874634250187264:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 3403us (15645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790825.951932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:0.0:1787790825.956843:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.956951:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250187520 00000100:00100000:3.0:1787790825.956962:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250187520 00000100:00100000:3.0:1787790825.957022:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 131 00000100:00100000:3.0:1787790825.957032:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+63:11385:x1874634250187520:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790825.957145:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.957164:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.957174:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790825.957403:0:10093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1787790825.957464:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b154160 reply state 0000000091600319 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.957497:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790825.957503:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:3.0:1787790825.957506:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787790825.957509:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790825.957626:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+65:11385:x1874634250187520:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 595us (800us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787790825.957634:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 131 00000100:00100000:0.0:1787790825.961252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790825.961762:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250187648 00000100:00100000:1.0:1787790825.961778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250187648 00000100:00100000:1.0:1787790825.961869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:1.0:1787790825.961888:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+65:11385:x1874634250187648:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790825.961915:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790825.961943:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.962007:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.962022:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790825.962044:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:1.0:1787790825.962048:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790825.962052:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fac00, rc 0) 00000100:00100000:1.0:1787790825.962146:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+66:11385:x1874634250187648:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 251us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790825.962157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:1.0:1787790825.966356:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790825.972948:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250187776 00000100:00100000:2.0:1787790825.972969:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250187776 00000100:00100000:2.0:1787790825.974815:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:2.0:1787790825.974827:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250187776:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787790825.975438:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790825.976251:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250187776:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 1415us (9897us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787790825.976265:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:3.0:1787790825.986144:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790825.986338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250188032 00000100:00100000:0.0:1787790825.986351:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250188032 00000100:00100000:0.0:1787790825.986430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:0.0:1787790825.986443:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+66:11385:x1874634250188032:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787790825.986775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+67:11385:x1874634250188032:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 335us (645us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787790825.986782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:1.0:1787790825.996014:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790825.996905:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250188288 00000100:00100000:3.0:1787790825.996922:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250188288 00000100:00100000:3.0:1787790825.999739:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:3.0:1787790825.999768:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+67:11385:x1874634250188288:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790825.999935:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+67:11385:x1874634250188288:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 183us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790825.999942:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:1.0:1787790826.002898:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790826.003472:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250188416 00000100:00100000:2.0:1787790826.003483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250188416 00000100:00100000:2.0:1787790826.003591:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:2.0:1787790826.003602:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+67:11385:x1874634250188416:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790826.003640:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790826.003664:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e326 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.003778:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e32d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.003793:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e32d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.003805:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e32d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790826.003846:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790826.003866:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e32d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.003891:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e326 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d34 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.003908:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e32d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d34 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.003917:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:2.0:1787790826.003920:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787790826.003924:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994a00, rc 0) 00000100:00100000:2.0:1787790826.003979:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+68:11385:x1874634250188416:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 379us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790826.003987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:0.0:1787790826.006997:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.007175:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250188544 00000100:00100000:3.0:1787790826.007189:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250188544 00000100:00100000:3.0:1787790826.007259:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:3.0:1787790826.007267:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+9:2403:x1874634250188544:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790826.007289:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790826.007313:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d3b expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790826.007376:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85eb, blocks: 0x0 00010000:00010000:3.0:1787790826.007421:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1787790826.007427:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790826.007441:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 10 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.007463:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 10 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.007485:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e000, rc 0) 00000100:00100000:3.0:1787790826.007555:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:2403:x1874634250188544:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 289us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.007561:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:0.0:1787790826.017937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.018047:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250188800 00000100:00100000:1.0:1787790826.018056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250188800 00000100:00100000:1.0:1787790826.018116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:1.0:1787790826.018126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+68:11385:x1874634250188800:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790826.018247:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+68:11385:x1874634250188800:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 122us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790826.018256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:3.0:1787790826.024408:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790826.027432:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250188928 00000100:00100000:2.0:1787790826.027447:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250188928 00000100:00100000:2.0:1787790826.027528:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:2.0:1787790826.027538:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3898780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+10:11385:x1874634250188928:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790826.027556:0:10092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790826.027577:0:10092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d42 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.027610:0:10092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.027620:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790826.027625:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790826.027631:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 11 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.027666:0:10092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.027680:0:10092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790826.027695:0:10092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10092:1874634268081664:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790826.027818:0:10092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790826.037572:0:10092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10092:1874634268081664:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790826.037615:0:10092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 11 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.037654:0:10092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994c00, rc 0) 00000100:00100000:2.0:1787790826.037747:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3898780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+11:11385:x1874634250188928:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 10210us (13351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790826.037756:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:1.0:1787790826.048964:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.049071:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189056 00000100:00100000:0.0:1787790826.049081:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189056 00010000:00010000:0.0:1787790826.049127:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.049184:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 74 00000100:00100000:0.0:1787790826.049194:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+11:2402:x1874634250189056:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790826.049209:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790826.049229:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.049243:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.049287:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1e334 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d3b expref: 11 pid: 8426 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.049305:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790826.049309:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790826.049317:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 10 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.049339:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 10 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.049376:0:8442:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 10 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.049391:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8442:1874634268081792:192.168.202.22@tcp:105: 00000100:00100000:0.0:1787790826.049474:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790826.056938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.057381:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189184 00000100:00100000:1.0:1787790826.057390:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189184 00002000:00100000:1.0:1787790826.057435:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff916fc389b840 x1874634250189184/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:667/0 lens 504/0 e 0 to 0 dl 1787790837 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790826.057446:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc389b840 with x1874634250189184 ext(0->12) 00002000:00010000:1.0:1787790826.057452:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc389b840 00000100:00100000:1.0:1787790826.057484:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:1.0:1787790826.057494:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+11:2402:x1874634250189184:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787790826.059078:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+13:2402:x1874634250189184:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 Request processed in 1570us (2134us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787790826.059096:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00002000:00100000:1.0:1787790826.059109:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff916fc389b840 x1874634250189184/t4294967309(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:667/0 lens 504/448 e 0 to 0 dl 1787790837 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790826.059117:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc389b840 with x1874634250189184 ext(0->12) 00002000:00010000:1.0:1787790826.059122:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc389b840 00000100:00100000:3.0:1787790826.062410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.062559:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189312 00000100:00100000:1.0:1787790826.062571:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189312 00000100:00100000:1.0:1787790826.062646:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:1.0:1787790826.062655:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+68:11385:x1874634250189312:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787790826.064005:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8442:1874634268081792:192.168.202.22@tcp:105: 00010000:00010000:0.0:1787790826.064044:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790826.064119:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+12:2402:x1874634250189056:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 14925us (15168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790826.064131:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 74 00000001:00080000:2.0:1787790826.066662:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1787790826.066688:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787790826.066743:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787790826.066758:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff916fc31d0c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787790826.066763:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170c8779900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff916fc31d03c0 00000020:00080000:2.0:1787790826.066767:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170c8779e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff916fc2765000 00000004:00080000:2.0:1787790826.066792:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787790826.066822:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170d00eb780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787790826.066826:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170c8779700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170d00eb840 00000020:00080000:2.0:1787790826.066831:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170c8779a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9170e4cbce00 00010000:00010000:0.0:1787790826.066923:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.066936:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.066961:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.066980:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790826.066985:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.066997:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067029:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9170e15d8d00) 00010000:00010000:0.0:1787790826.067033:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790826.067039:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067047:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e040 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067081:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787790826.067086:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:0.0:1787790826.067092:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067102:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067108:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790826.067111:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067129:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787790826.067157:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787790826.067177:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268082048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787790826.067263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790826.067302:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787790826.067310:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff916fc3701800) 00000100:00100000:1.0:1787790826.067312:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268081920:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787790826.067317:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790826.067334:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067342:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1e0e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.067357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790826.067366:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067375:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067381:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067387:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165e800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790826.067389:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067395:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067404:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:0.0:1787790826.067406:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790826.067410:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067423:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165e800/0xcf9477fddcf1e166 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067439:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067444:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067451:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067456:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fae00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790826.067459:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067465:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.067513:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+19:11385:x1874634250189312:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 4856us (5116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790826.067522:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 136 00010000:00010000:0.0:1787790826.067603:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9170fbd4a800) 00010000:00010000:0.0:1787790826.067607:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790826.067611:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067619:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e189 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.067649:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068070:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068088:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068094:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790826.068097:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068104:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068113:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790826.068116:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790826.068119:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068126:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e25b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068153:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068161:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068168:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068173:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790826.068176:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068193:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068202:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:0.0:1787790826.068204:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787790826.068208:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068214:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1e318 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.068241:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268082048 00000100:00100000:0.0:1787790826.068250:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268082048 00000100:00100000:0.0:1787790826.068290:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268081920 00000100:00100000:0.0:1787790826.068293:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268081920 00000100:00100000:0.0:1787790826.068334:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787790826.068353:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268082048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787790826.068384:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1787790826.068415:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f85ea, atime: 0x6a8f85ea, ctime: 0x6a8f85ea, blocks: 0x8 00010000:00010000:0.0:1787790826.068422:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068437:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1787790826.068441:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790826.068449:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068463:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068485:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068493:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068511:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787790826.068697:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268082048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (1431us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787790826.068724:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787790826.068741:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790826.068748:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268081920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787790826.068760:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1787790826.068774:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068789:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 11 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068797:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787790826.068801:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790826.068805:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068837:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 11 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068860:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 11 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.068877:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8428:1874634268082176:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790826.068947:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a9300 going to sleep for 11 seconds 00010000:00010000:0.0:1787790826.068964:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790826.068971:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068979:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790826.068983:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.068992:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.069006:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.069013:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000847b4bd4/0xcf9477fddcf1e342 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.069030:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790826.069032:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790826.069039:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790826.069070:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787790826.069076:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1787790826.069094:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170c2c2d2c0, transno 4294967302 00000004:00080000:0.0:1787790826.069105:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1787790826.069120:0:3639:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff916fc3b89e00 x1874634268082048/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787790842 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787790826.069131:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff916fc3b89e00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1787790826.069137:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268082048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787790826.075418:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.075516:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189440 00000100:00100000:0.0:1787790826.075532:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189440 00000100:00100000:0.0:1787790826.075607:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:0.0:1787790826.075618:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3899680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+12:2402:x1874634250189440:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787790826.078391:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787790826.078420:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1787790826.078615:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3899680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250189440:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 2992us (3204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790826.078628:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:2.0:1787790826.088385:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.092763:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189696 00000100:00100000:1.0:1787790826.092777:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189696 00000100:00100000:1.0:1787790826.092845:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:1.0:1787790826.092855:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+16:11385:x1874634250189696:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790826.092905:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790826.092931:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e32d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d34 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.092950:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:1.0:1787790826.092955:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790826.093000:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.093014:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.093024:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790826.093137:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000529cdb8c reply state 00000000fdba98d3 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.093150:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.093156:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:1.0:1787790826.093159:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790826.093162:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790826.093266:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+17:11385:x1874634250189696:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 412us (4891us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787790826.093274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787790826.095565:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8428:1874634268082176:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790826.095596:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790826.099249:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790826.099295:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.099382:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189824 00000100:00100000:1.0:1787790826.099394:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189824 00010000:00010000:1.0:1787790826.099437:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 7 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.099482:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:1.0:1787790826.099492:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250189824:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790826.099510:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790826.099517:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 7 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.099546:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 7 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.099572:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdf73b6/0xcf9477fddcf1e0f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c9a expref: 7 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.099592:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790826.099597:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790826.099603:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.099614:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.099640:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790826.099687:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250189824:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 195us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790826.099695:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:0.0:1787790826.100358:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250189952 00000100:00100000:0.0:1787790826.100365:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250189952 00000100:00100000:0.0:1787790826.100407:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787790826.100415:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250189952:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787790826.100568:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787790826.100572:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787790826 00002000:00010000:0.0:1787790826.100583:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787790826 00002000:00010000:0.0:1787790826.100586:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787790827 -> 1787790826 00002000:00010000:0.0:1787790826.100588:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787790826.100635:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250189952:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 221us (1339us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787790826.100643:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00010000:00010000:0.0:1787790826.100668:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.100679:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.100690:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.100699:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.100752:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787790826.100863:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268081920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32114us (33505us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787790826.100870:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787790826.100910:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1787790826.100917:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1787790826.100941:0:3639:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff916fc3b88b40 x1874634268081920/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787790842 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787790826.100952:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff916fc3b88b40/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787790826.100974:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268081920:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787790826.101315:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790826.101333:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.101342:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790826.101347:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.101370:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.101388:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.101397:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e349 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.101417:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790826.101419:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790826.101421:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790826.103518:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.103615:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250190208 00000100:00100000:0.0:1787790826.103624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250190208 00000100:00100000:0.0:1787790826.103683:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:0.0:1787790826.103693:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+17:11385:x1874634250190208:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787790826.103785:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.103803:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.103813:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.103848:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.103862:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 17 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.103877:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268082304:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790826.103953:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790826.110825:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268082304:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790826.110866:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790826.111010:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.111494:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250190336 00000100:00100000:3.0:1787790826.111504:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250190336 00010000:00010000:3.0:1787790826.111545:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790826.111576:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 76 00000100:00100000:3.0:1787790826.111585:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:2402:x1874634250190336:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790826.111601:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790826.111608:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.111639:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.111663:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e311 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d26 expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.111678:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:3.0:1787790826.111684:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.111694:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.111743:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.111767:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790826.111830:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+17:2402:x1874634250190336:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 242us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.111839:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 76 00010000:00010000:1.0:1787790826.112597:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112608:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112649:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112656:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112674:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112681:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790826.112685:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112693:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112734:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:1.0:1787790826.112738:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787790826.112742:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.112750:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e357 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.112807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+16:11385:x1874634250190208:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 Request processed in 9113us (9296us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787790826.112816:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:2.0:1787790826.119665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.119791:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250190464 00000100:00100000:0.0:1787790826.119802:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250190464 00000100:00100000:0.0:1787790826.119894:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:0.0:1787790826.119907:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250190464:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787790826.119955:0:10092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.119994:0:10092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 7 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.120003:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787790826.120007:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790826.120012:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.120048:0:10092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 7 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.120062:0:10092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 7 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.120078:0:10092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10092:1874634268082432:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790826.120375:0:10092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c51a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787790826.133615:0:10092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10092:1874634268082432:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790826.133647:0:10092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.134037:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.134295:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250190592 00000100:00100000:1.0:1787790826.134303:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250190592 00010000:00010000:1.0:1787790826.134350:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 8 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.134390:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 77 00000100:00100000:1.0:1787790826.134401:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250190592:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790826.134430:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790826.134453:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 8 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.134476:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 8 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.134500:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1e33b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d42 expref: 8 pid: 10092 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.134519:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790826.134524:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790826.134530:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.134541:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.134571:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790826.134625:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250190592:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 225us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790826.134634:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 77 00010000:00010000:0.0:1787790826.135570:0:10092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135584:0:10092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135608:0:10092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135633:0:10092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135642:0:10092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135651:0:10092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790826.135655:0:10092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135666:0:10092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135681:0:10092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790826.135690:0:10092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ed129d/0xcf9477fddcf1e35e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790826.135795:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250190464:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 15888us (16138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790826.135806:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:3.0:1787790826.141257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.141550:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250190848 00000100:00100000:1.0:1787790826.141561:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250190848 00000100:00100000:1.0:1787790826.141618:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:1.0:1787790826.141629:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+16:11385:x1874634250190848:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787790826.141761:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.141781:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 16 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.141792:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.141828:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 16 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.141843:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 16 pid: 10094 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.141860:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268082560:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790826.141943:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790826.148793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.148886:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268082560:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790826.148916:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790826.149138:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250190976 00000100:00100000:3.0:1787790826.149144:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250190976 00010000:00010000:3.0:1787790826.149181:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 17 pid: 10094 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790826.149221:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:3.0:1787790826.149230:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+17:2402:x1874634250190976:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790826.149259:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790826.149267:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 17 pid: 10094 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149279:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 17 pid: 10094 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149301:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e254 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223cee expref: 17 pid: 10094 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149316:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790826.149333:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149343:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149350:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149357:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.149386:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790826.149435:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+16:2402:x1874634250190976:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 205us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.149444:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 78 00010000:00010000:1.0:1787790826.149550:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.149557:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.149790:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.149807:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.149816:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.149845:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.149858:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 16 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.149872:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268082688:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790826.149920:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e47b8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790826.152877:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.152989:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268082688:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790826.153024:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790826.153096:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250191104 00000100:00100000:2.0:1787790826.153103:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250191104 00010000:00010000:2.0:1787790826.153143:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790826.153185:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 79 00000100:00100000:2.0:1787790826.153195:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+17:2402:x1874634250191104:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790826.153210:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790826.153217:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.153230:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.153253:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e31f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d2d expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.153269:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:2.0:1787790826.153275:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.153284:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.153293:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.153350:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790826.153412:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+16:2402:x1874634250191104:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 217us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790826.153420:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 79 00010000:00010000:1.0:1787790826.153478:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.153487:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790826.153595:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787790826.153749:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787790826.153788:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787790826.153863:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10094:1874634268082816:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787790826.153923:0:10094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790826.153952:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790826.154134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268082816 00000100:00100000:2.0:1787790826.154140:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268082816 00000100:00100000:2.0:1787790826.154183:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787790826.154191:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10094:x1874634268082816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787790826.154265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10094:x1874634268082816:12345-0@lo:1000:mdt00_004.0 Request processed in 75us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790826.154273:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787790826.160965:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10094:1874634268082816:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787790826.161150:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787790826.161228:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10094:1874634268082944:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787790826.161315:0:10094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790826.161366:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790826.161442:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268082944 00000100:00100000:0.0:1787790826.161456:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268082944 00000100:00100000:0.0:1787790826.161528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787790826.161538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10094:x1874634268082944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787790826.161682:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10094:x1874634268082944:12345-0@lo:1000:mdt00_004.0 Request processed in 144us (366us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787790826.161691:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787790826.161975:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10094:1874634268082944:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787790826.162021:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162030:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162039:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162044:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790826.162049:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162056:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162073:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:1.0:1787790826.162076:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790826.162080:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162086:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e36c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162120:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162127:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162133:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162138:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790826.162141:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162146:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162154:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:1.0:1787790826.162156:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790826.162163:0:10094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162172:0:10094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162181:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.162213:0:10094:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.162236:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268083072:192.168.202.22@tcp:105: 00000100:00100000:1.0:1787790826.162312:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c1254300 going to sleep for 11 seconds 00000100:00100000:1.0:1787790826.167462:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268083072:192.168.202.22@tcp:105: 00010000:00010000:1.0:1787790826.167496:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167507:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e2af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167545:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167559:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167571:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167582:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167589:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167595:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167601:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790826.167605:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167624:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167637:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:1.0:1787790826.167640:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790826.167644:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167650:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e373 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167661:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167667:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167674:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167678:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fba00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790826.167682:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167688:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167694:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:1.0:1787790826.167697:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790826.167700:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.167765:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e365 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.167924:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+19:11385:x1874634250190848:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 26295us (26682us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787790826.167935:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 139 00000020:00080000:1.0:1787790826.167941:0:10094:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787790826.168589:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790826.168596:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790826.169146:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787790826.169159:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790826.176198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790826.176305:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.176834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250191232 00000100:00100000:1.0:1787790826.176843:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250191488 00000100:00100000:3.0:1787790826.176852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250191232 00000100:00100000:1.0:1787790826.176855:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250191488 00000100:00100000:1.0:1787790826.176909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:1.0:1787790826.176978:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+20:11385:x1874634250191488:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787790826.177249:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787790826.177280:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1787790826.177313:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.177340:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.177352:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.177361:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.177368:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.177375:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.177421:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790826.177503:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:11385:x1874634250191488:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 583us (1196us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787790826.177511:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 31 00000020:00080000:1.0:1787790826.177517:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787790826.177535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:1.0:1787790826.177543:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:11384:x1874634250191232:12345-192.168.202.22@tcp:49:lfs.0 00000100:00100000:1.0:1787790826.177601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:11384:x1874634250191232:12345-192.168.202.22@tcp:49:lfs.0 Request processed in 58us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790826.177608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 32 00010000:00010000:3.0:1787790826.178382:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790826.178392:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.178401:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790826.178405:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.178414:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.178429:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:3.0:1787790826.178432:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787790826.178438:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.178444:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e37a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.178460:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790826.178462:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790826.178464:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790826.197567:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.197785:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250191744 00000100:00100000:3.0:1787790826.197803:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250191744 00000100:00100000:3.0:1787790826.197902:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:3.0:1787790826.197914:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:11384:x1874634250191744:12345-192.168.202.22@tcp:58:lfs.0 00000040:00080000:3.0:1787790826.198167:0:10093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787790826.198287:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:11384:x1874634250191744:12345-192.168.202.22@tcp:58:lfs.0 Request processed in 374us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.198296:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:2.0:1787790826.223314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790826.223560:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250191872 00000100:00100000:1.0:1787790826.223574:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250191872 00000100:00100000:1.0:1787790826.223696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:1.0:1787790826.223731:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+21:11387:x1874634250191872:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790826.223767:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790826.223800:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e381 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d49 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.223891:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.223908:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.223921:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.223961:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.223970:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.223977:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.224100:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.224112:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 22 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.224121:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.224165:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 22 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790826.224182:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 22 pid: 10093 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790826.224198:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268083200:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790826.224309:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790826.226835:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.227122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192128 00000100:00100000:3.0:1787790826.227153:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192128 00000100:00100000:3.0:1787790826.227228:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:3.0:1787790826.227242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+23:6168:x1874634250192128:12345-192.168.202.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787790826.227999:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268083200:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790826.228040:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790826.228450:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+24:6168:x1874634250192128:12345-192.168.202.22@tcp:35:ldlm_bl.0 Request processed in 1207us (1625us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787790826.228462:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:0.0:1787790826.230357:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.230450:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192256 00000100:00100000:3.0:1787790826.230461:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192256 00010000:00010000:3.0:1787790826.230520:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 24 pid: 10093 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790826.230566:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 80 00000100:00100000:3.0:1787790826.230577:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+24:2402:x1874634250192256:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790826.230625:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790826.230635:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 24 pid: 10093 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.230650:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 24 pid: 10093 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.230679:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1e2a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d0a expref: 24 pid: 10093 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.230700:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790826.230761:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.230783:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.230791:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790826.230835:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790826.230900:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+23:2402:x1874634250192256:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 324us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.230908:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 80 00010000:00010000:2.0:1787790826.233907:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.233932:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790826.234033:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787790826.234039:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790826.234072:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234122:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234134:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234140:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234148:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234155:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790826.234160:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234170:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234189:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:2.0:1787790826.234193:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790826.234200:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234207:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e388 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234228:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234235:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234248:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234253:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26faa00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790826.234256:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234263:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234272:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff916fc268f800) 00010000:00010000:2.0:1787790826.234275:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790826.234278:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234284:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e38f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234354:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e381 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d49 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234372:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d49 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790826.234380:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790826.234382:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790826.234384:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa400, rc 0) 00000100:00100000:2.0:1787790826.234512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+22:11387:x1874634250191872:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 10804us (11211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790826.234533:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 141 00010000:00010000:0.0:1787790826.315648:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790826.951900:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.957755:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.957831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.957865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790826.957926:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790826.958612:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192640 00000100:00100000:3.0:1787790826.958626:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192640 00000100:00100000:3.0:1787790826.958741:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 99 00000100:00100000:3.0:1787790826.958754:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250192640:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790826.958863:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250192640:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 111us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.958872:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 99 00000100:00100000:3.0:1787790826.958903:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192896 00000100:00100000:3.0:1787790826.958907:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192896 00000100:00100000:3.0:1787790826.958937:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192512 00000100:00100000:3.0:1787790826.958940:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192512 00000100:00100000:3.0:1787790826.958962:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192768 00000100:00100000:3.0:1787790826.958965:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192768 00000100:00100000:3.0:1787790826.958985:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 272 00000100:00100000:3.0:1787790826.958991:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250192896:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790826.959025:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250192896:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 33us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.959043:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 272 00000100:00100000:3.0:1787790826.959058:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 273 00000100:00100000:3.0:1787790826.959065:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250192512:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790826.959092:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250192512:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.959098:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 273 00000100:00100000:3.0:1787790826.959109:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 274 00000100:00100000:3.0:1787790826.959115:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250192768:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790826.959140:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250192768:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790826.959147:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 274 00000100:00080000:0.0:1787790826.960183:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790826.960190:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790826.960194:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790826.963735:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250192384 00000100:00100000:1.0:1787790826.963758:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250192384 00000100:00100000:1.0:1787790826.964996:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 379 00000100:00100000:1.0:1787790826.965018:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250192384:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790826.966015:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250192384:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 998us (14312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790826.966031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 379 00000040:00080000:3.0:1787790827.144619:0:14251:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790827.144632:0:14251:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790827.144667:0:14251:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787790827.144674:0:14251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787790827.212476:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790827.212491:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790827.212527:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787790827.212540:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790827.214064:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc389a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268083328:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790827.214205:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c55b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790827.228397:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc389a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268083328:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790827.234169:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790827.239983:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250193024 00000100:00100000:3.0:1787790827.240005:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250193024 00000100:00100000:3.0:1787790827.240126:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:3.0:1787790827.240138:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+22:11399:x1874634250193024:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787790827.240198:0:10093:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787790827.240367:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+22:11399:x1874634250193024:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 231us (6213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790827.240375:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00080000:3.0:1787790827.240407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790827.249990:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790827.253334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250193280 00000100:00100000:1.0:1787790827.253356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250193280 00000100:00100000:3.0:1787790827.256006:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:3.0:1787790827.256024:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+22:11399:x1874634250193280:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790827.256055:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790827.256084:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e39d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d50 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.256306:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e3a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.256338:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.256356:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790827.256369:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787790827.256524:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e39d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d50 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.256548:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d50 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.256583:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790827.256586:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790827.256591:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38000, rc 0) 00000100:00100000:3.0:1787790827.256865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+24:11399:x1874634250193280:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 844us (6891us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787790827.256875:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:3.0:1787790827.282922:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790827.283031:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250193408 00000100:00100000:2.0:1787790827.283045:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250193408 00000100:00100000:2.0:1787790827.283144:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:2.0:1787790827.283158:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+24:2403:x1874634250193408:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790827.283182:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790827.283930:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e3a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d50 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790827.283960:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:2.0:1787790827.283967:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790827.284055:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:2403:x1874634250193408:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 899us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790827.284066:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:2.0:1787790827.291025:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790827.291147:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250193664 00000100:00100000:3.0:1787790827.291161:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250193664 00000100:00100000:3.0:1787790827.291242:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 144 00000100:00100000:3.0:1787790827.291253:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+23:11399:x1874634250193664:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787790827.291340:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.291361:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.291373:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292232:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292244:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292252:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292277:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd39000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790827.292282:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292291:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292307:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790827.292310:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787790827.292325:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790827.292333:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790827.292541:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+24:11399:x1874634250193664:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 1287us (1531us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787790827.292551:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 144 00000040:00080000:3.0:1787790827.294950:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790827.294960:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790827.295480:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787790827.295498:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790827.298221:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790827.299298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250193920 00000100:00100000:0.0:1787790827.299325:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250193920 00000100:00100000:0.0:1787790827.299419:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:0.0:1787790827.299430:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+24:11399:x1874634250193920:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787790827.299722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+25:11399:x1874634250193920:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 274us (1493us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787790827.300266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00010000:00010000:0.0:1787790827.342868:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790828.304395:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790828.304419:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790828.304445:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787790828.304455:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790828.362944:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268083584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790828.363045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790828.363104:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790828.363110:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268083456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790828.363132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790828.363166:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268083584 00000100:00100000:0.0:1787790828.363174:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268083584 00000100:00100000:0.0:1787790828.363243:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268083456 00000100:00100000:0.0:1787790828.363247:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268083456 00000100:00100000:0.0:1787790828.363264:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787790828.363273:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268083584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790828.363320:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790828.363366:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268083584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790828.363384:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787790828.363402:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787790828.363408:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268083456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790828.363418:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790828.363440:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268083456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790828.363446:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1787790828.363463:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790828.363513:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268083456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790828.363580:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268083584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787790828.364095:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790828.686191:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787790829.174115:0:14303:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790829.174128:0:14303:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790829.174178:0:14303:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787790829.174186:0:14303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790829.362195:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790829.362519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194176 00000100:00100000:3.0:1787790829.362545:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194176 00000100:00100000:3.0:1787790829.362630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 145 00000100:00100000:3.0:1787790829.362640:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+25:11419:x1874634250194176:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790829.362669:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790829.362693:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e3b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790829.362866:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790829.362881:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790829.362896:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790829.362905:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00080000:1.0:1787790829.364128:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790829.364685:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e3b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d57 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790829.364752:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d57 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790829.364763:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:3.0:1787790829.364767:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787790829.364771:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39000, rc 0) 00000100:00100000:3.0:1787790829.364879:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:11419:x1874634250194176:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 2239us (2702us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787790829.364890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 145 00000100:00100000:1.0:1787790829.372556:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790829.372612:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194304 00000100:00100000:1.0:1787790829.372625:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194304 00000100:00100000:1.0:1787790829.372694:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00100000:1.0:1787790829.372737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+27:11419:x1874634250194304:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:1.0:1787790829.372832:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.372855:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.372889:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.372937:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.372946:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.372953:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.374101:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fac00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790829.374108:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.374120:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.374144:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:1.0:1787790829.374148:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790829.374154:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790829.374162:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e3ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790829.374291:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+27:11419:x1874634250194304:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 1582us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790829.374312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 146 00010000:00010000:0.0:1787790829.390511:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790829.390549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268083712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790829.390666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790829.390789:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268083712 00000100:00100000:0.0:1787790829.390799:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268083712 00000100:00100000:0.0:1787790829.390861:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787790829.390874:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268083712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790829.390922:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790829.390980:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268083712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790829.390987:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787790829.391042:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268083712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790829.396010:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268083840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790829.396113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790829.396329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268083840 00000100:00100000:1.0:1787790829.396357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268083840 00000100:00100000:1.0:1787790829.396426:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787790829.396447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268083840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790829.396500:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787790829.396567:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268083840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790829.396575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787790829.396830:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268083840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790829.473124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790829.473370:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194432 00000100:00100000:0.0:1787790829.473386:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194432 00000100:00100000:0.0:1787790829.473534:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:0.0:1787790829.473550:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250194432:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:0.0:1787790829.473577:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790829.473607:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e3d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d5e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790829.473641:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f85ea, atime: 0x6a8f85ea, ctime: 0x6a8f85ea, blocks: 0x8 00010000:00010000:0.0:1787790829.473668:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1787790829.473673:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790829.473685:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d5e expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790829.473775:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d5e expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790829.473793:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5000, rc 0) 00000100:00100000:0.0:1787790829.473883:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250194432:12345-192.168.202.22@tcp:101:cat.0 Request processed in 338us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790829.473891:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00080000:1.0:1787790829.476356:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790829.477801:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790829.478082:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194560 00000100:00100000:2.0:1787790829.478096:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194560 00002000:00100000:2.0:1787790829.478168:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff916fc389b0c0 x1874634250194560/t0(0) o3->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:670/0 lens 488/0 e 0 to 0 dl 1787790840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790829.478183:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc389b0c0 with x1874634250194560 ext(0->4095) 00002000:00010000:2.0:1787790829.478189:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc389b0c0 00000100:00100000:2.0:1787790829.478229:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:2.0:1787790829.478240:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250194560:12345-192.168.202.22@tcp:3:cat.0 00000100:00100000:2.0:1787790829.478533:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250194560:12345-192.168.202.22@tcp:3:cat.0 Request processed in 294us (746us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787790829.478547:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00002000:00100000:2.0:1787790829.478555:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff916fc389b0c0 x1874634250194560/t0(0) o3->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:670/0 lens 488/4536 e 0 to 0 dl 1787790840 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790829.478562:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc389b0c0 with x1874634250194560 ext(0->4095) 00002000:00010000:2.0:1787790829.478565:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc389b0c0 00010000:00010000:1.0:1787790830.411662:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787790830.925980:0:9995:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379874270539ns, next at 380874265608ns, rc = 0 00000100:00100000:2.0:1787790830.926022:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790830.926053:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268083968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790830.926162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790830.926252:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268083968 00000100:00100000:2.0:1787790830.926262:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268083968 00000100:00100000:2.0:1787790830.926363:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787790830.926376:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874634268083968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790830.926417:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787790830.926485:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874634268083968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790830.926493:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787790830.926526:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790830.926578:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268083968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790830.926999:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790830.927015:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268084096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790830.927059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790830.927184:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084096 00000100:00100000:0.0:1787790830.927190:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084096 00000100:00100000:0.0:1787790830.927240:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787790830.927249:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268084096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790830.927263:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787790830.927313:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268084096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790830.927320:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787790830.927353:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268084096:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787790830.927401:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790830.933180:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268084352:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.933297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790830.933352:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268084864:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.933375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790830.933396:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268085376:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.933418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790830.933645:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787790830.933653:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc389a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268084224:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.933691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790830.933742:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268084736:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.933793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790830.933815:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268085248:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.933844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790830.934156:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084352 00000100:00100000:3.0:1787790830.934168:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084352 00000100:00100000:3.0:1787790830.934232:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084864 00000100:00100000:3.0:1787790830.934236:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084864 00000100:00100000:3.0:1787790830.934263:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085376 00000100:00100000:3.0:1787790830.934267:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085376 00000100:00100000:3.0:1787790830.934290:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084736 00000100:00100000:3.0:1787790830.934294:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084736 00000100:00100000:3.0:1787790830.934312:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787790830.934323:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268084352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.934391:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268084352:12345-0@lo:400:kworker.0 Request processed in 69us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.934400:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787790830.934566:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268084608:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.934610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790830.934637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268085120:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.934661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790830.934684:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787790830.934701:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268084480:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.934753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790830.934772:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268084992:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.934794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790830.934806:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268085504:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.934825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790830.934856:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084608 00000100:00100000:2.0:1787790830.934860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084608 00000100:00100000:2.0:1787790830.934895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084480 00000100:00100000:2.0:1787790830.934898:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084480 00000100:00100000:2.0:1787790830.934914:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787790830.935107:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268084608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.935160:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268084608:12345-0@lo:400:kworker.0 Request processed in 239us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790830.935167:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787790830.935187:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787790830.935193:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268084480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.935220:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268084480:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790830.935225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787790830.935244:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085248 00000100:00100000:2.0:1787790830.935248:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085248 00000100:00100000:2.0:1787790830.935278:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085120 00000100:00100000:2.0:1787790830.935291:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085120 00000100:00100000:2.0:1787790830.935314:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787790830.935320:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4537c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268085248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.935355:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4537c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268085248:12345-0@lo:400:kworker.0 Request processed in 35us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790830.935370:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787790830.935384:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787790830.935390:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.935418:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268085120:12345-0@lo:400:kworker.0 Request processed in 29us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.935539:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084992 00000100:00100000:3.0:1787790830.935543:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084992 00000100:00100000:3.0:1787790830.935561:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085504 00000100:00100000:3.0:1787790830.935564:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085504 00000100:00100000:3.0:1787790830.935580:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787790830.935587:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268084864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.935625:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268084864:12345-0@lo:400:kworker.0 Request processed in 38us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.935631:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787790830.935642:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787790830.935649:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268085376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.935677:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268085376:12345-0@lo:400:kworker.0 Request processed in 30us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.935683:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787790830.935696:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787790830.935716:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4534f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268084736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.935746:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4534f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268084736:12345-0@lo:400:kworker.0 Request processed in 44us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.935751:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787790830.935763:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787790830.935768:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268084992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.935794:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268084992:12345-0@lo:400:kworker.0 Request processed in 27us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.935799:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787790830.935809:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787790830.935815:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268085504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.936031:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268085504:12345-0@lo:400:kworker.0 Request processed in 215us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790830.936038:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787790830.936100:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268084736:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.936115:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268085248:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.936129:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268084352:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.936139:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268084864:0@lo:400:kworker.0 00000100:00100000:3.0:1787790830.936149:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268085376:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.936533:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787790830.936597:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268084480:0@lo:400:kworker.0 00010000:00080000:2.0:1787790830.936614:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4460780 x1874634268084992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790830.936625:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268084992:0@lo:400:kworker.0 00010000:00080000:2.0:1787790830.936634:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4462940 x1874634268085504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790830.936643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268085504:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.936654:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268084608:0@lo:400:kworker.0 00000100:00100000:2.0:1787790830.936666:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268085120:0@lo:400:kworker.0 00000100:00100000:0.0:1787790830.938325:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268084224 00000100:00100000:0.0:1787790830.938346:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268084224 00000100:00100000:0.0:1787790830.938516:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787790830.938528:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268084224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790830.938664:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268084224:12345-0@lo:400:kworker.0 Request processed in 138us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790830.938671:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787790830.938762:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc389a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268084224:0@lo:400:kworker.0 00000100:00080000:1.0:1787790830.939054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790830.939064:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790830.939067:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790831.435403:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787790831.960132:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1787790831.960195:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1787790831.960234:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170c1254780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787790831.960241:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170fc11e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170c12ede40 00000020:00080000:3.0:1787790831.960245:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170fc11e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9170e4f4a600 00010000:00010000:2.0:1787790831.960739:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790831.960758:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790831.960767:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790831.960775:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790831.960805:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790831.960816:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787790831.961098:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:3.0:1787790831.961120:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790831.961158:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268085632:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787790831.961575:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff916fc268fb00) 00010000:00010000:2.0:1787790831.961581:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790831.961589:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790831.961599:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e350 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787790831.961686:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1787790831.961985:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1787790831.961994:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1787790831.962378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787790831.962432:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:0.0:1787790831.963278:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085632 00000100:00100000:0.0:1787790831.963292:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085632 00000100:00100000:0.0:1787790831.963366:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787790831.963378:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4535e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268085632:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1787790831.963663:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00002000:00010000:0.0:1787790831.964120:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787790831.964125:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787790826 -> 1787790826 00002000:00010000:0.0:1787790831.964128:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1787790826 -> 1787790826 00002000:00010000:0.0:1787790831.964130:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787790826 -> 1787790826 00002000:00010000:0.0:1787790831.964132:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787790831.964634:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4535e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268085632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1253us (2254us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787790831.964646:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787790831.969406:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787790831.969427:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff916fc3b88b40, transno 4294967311 00000004:00080000:3.0:1787790831.969527:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787790831.969578:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9170c827b840 x1874634268085632/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787790847 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787790831.969633:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170c827b840/2, rc 0, transno 4294967313 00000100:00100000:3.0:1787790831.979653:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c827b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268085632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787790832.075070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790832.075157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790832.075198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790832.075286:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194816 00000100:00100000:1.0:1787790832.075300:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194816 00000100:00100000:1.0:1787790832.075396:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194944 00000100:00100000:1.0:1787790832.075400:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194944 00000100:00100000:1.0:1787790832.075453:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 281 00000100:00100000:1.0:1787790832.075468:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+13:2401:x1874634250194816:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790832.075574:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+13:2401:x1874634250194816:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 110us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790832.075583:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 281 00000100:00100000:1.0:1787790832.075606:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 282 00000100:00100000:1.0:1787790832.075613:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250194944:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790832.075664:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250194944:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 51us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790832.075671:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 282 00000100:00080000:2.0:1787790832.075966:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790832.075972:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790832.079540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250194688 00000100:00100000:3.0:1787790832.079559:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250194688 00000100:00100000:3.0:1787790832.079629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 381 00000100:00100000:3.0:1787790832.079640:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250194688:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790832.079749:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d63afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250194688:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 111us (4696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790832.079758:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 381 00000100:00100000:3.0:1787790832.079895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790832.080040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790832.080063:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195072 00000100:00100000:3.0:1787790832.080067:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195072 00000100:00100000:3.0:1787790832.080102:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195200 00000100:00100000:3.0:1787790832.080105:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195200 00000100:00100000:3.0:1787790832.080127:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:3.0:1787790832.080133:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250195072:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790832.080167:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2400:x1874634250195072:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790832.080173:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:3.0:1787790832.080184:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 103 00000100:00100000:3.0:1787790832.080190:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4534780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250195200:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790832.080209:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4534780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:2400:x1874634250195200:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 20us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790832.080242:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 103 00000100:00080000:3.0:1787790832.080277:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790832.080282:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790832.083211:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790832.083254:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790832.084641:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195328 00000100:00100000:1.0:1787790832.084656:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195328 00000100:00100000:1.0:1787790832.084753:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195456 00000100:00100000:1.0:1787790832.084758:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195456 00000100:00100000:1.0:1787790832.084802:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 283 00000100:00100000:1.0:1787790832.084814:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4537840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250195328:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790832.084930:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4537840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250195328:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 117us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790832.084938:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 283 00000100:00100000:1.0:1787790832.084961:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 284 00000100:00100000:1.0:1787790832.084968:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4535a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250195456:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790832.084994:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4535a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250195456:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 27us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790832.085001:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 284 00000100:00080000:1.0:1787790832.085023:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790832.085028:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787790832.460837:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790833.490550:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268085760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790833.490653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790833.490801:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790833.490809:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268085888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790833.490837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790833.490870:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085760 00000100:00100000:0.0:1787790833.490879:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085760 00000100:00100000:2.0:1787790833.491216:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268085888 00000100:00100000:2.0:1787790833.491222:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268085888 00000100:00100000:0.0:1787790833.491459:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787790833.495037:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790833.495557:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268085760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790833.495614:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790833.495757:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268085760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4288us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790833.495791:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787790833.498191:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787790833.498210:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3089a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268085888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790833.498243:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790833.498365:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3089a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268085888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (7514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790833.498373:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:1.0:1787790833.498841:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790833.504623:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268085888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790833.504648:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787790833.504655:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff916fc3b89e00, transno 4294967305 00000100:00100000:3.0:1787790833.504682:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268085760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790834.131610:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790834.131765:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195584 00000100:00100000:0.0:1787790834.131779:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195584 00000100:00100000:0.0:1787790834.131879:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:0.0:1787790834.131896:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+13:11072:x1874634250195584:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787790834.132054:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+13:11072:x1874634250195584:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 147us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790834.132064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00080000:2.0:1787790834.132206:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790834.135446:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790834.135568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195712 00000100:00100000:0.0:1787790834.135582:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195712 00000100:00100000:0.0:1787790834.135672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:0.0:1787790834.135686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:11072:x1874634250195712:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787790834.135843:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:11072:x1874634250195712:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 161us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790834.135852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00080000:2.0:1787790834.136121:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790834.144726:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790834.144819:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250195968 00000100:00100000:2.0:1787790834.144833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250195968 00000100:00100000:2.0:1787790834.144903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:2.0:1787790834.144915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+13:11072:x1874634250195968:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787790834.145236:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+14:11072:x1874634250195968:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 323us (541us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787790834.145246:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:3.0:1787790834.345002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790834.345270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196096 00000100:00100000:0.0:1787790834.345285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196096 00000100:00100000:0.0:1787790834.345401:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:0.0:1787790834.345413:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4536580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:11878:x1874634250196096:12345-192.168.202.22@tcp:101:lsof.0 00010000:00010000:0.0:1787790834.345441:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790834.345470:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e3dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790834.345560:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790834.345601:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790834.345617:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790834.345684:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790834.345688:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790834.345780:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790834.345812:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e3dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790834.345837:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790834.345848:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:0.0:1787790834.345852:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790834.345856:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4e00, rc 0) 00000100:00100000:0.0:1787790834.345944:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4536580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:11878:x1874634250196096:12345-192.168.202.22@tcp:101:lsof.0 Request processed in 532us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790834.345953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00080000:2.0:1787790834.346479:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790834.507098:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3088f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268086016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790834.507200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790834.507549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086016 00000100:00100000:0.0:1787790834.507560:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086016 00000100:00100000:0.0:1787790834.507629:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787790834.507640:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4536940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268086016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790834.507685:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790834.507794:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4536940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268086016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790834.507802:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787790834.507938:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268086144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790834.507977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790834.508158:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086144 00000100:00100000:3.0:1787790834.508164:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086144 00000100:00100000:3.0:1787790834.508205:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787790834.508213:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268086144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790834.508316:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787790834.508369:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268086144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790834.508376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787790834.508434:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3088f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268086016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790834.508530:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268086144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787790834.514957:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790835.530966:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790836.045933:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4535680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268086656:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.046070:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268087168:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.046113:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268087680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.046156:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787790836.046161:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4536d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268086528:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.046199:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046222:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.046268:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268087552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.046337:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087168 00000100:00100000:3.0:1787790836.046343:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087168 00000100:00100000:3.0:1787790836.046393:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087680 00000100:00100000:3.0:1787790836.046396:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087680 00000100:00100000:3.0:1787790836.046420:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790836.046429:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268087168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046480:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268087168:12345-0@lo:400:kworker.0 Request processed in 53us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.046487:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787790836.046505:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787790836.046512:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268087680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046538:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268087680:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.046560:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787790836.046590:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087040 00000100:00100000:3.0:1787790836.046594:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087040 00000100:00100000:3.0:1787790836.046617:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087552 00000100:00100000:3.0:1787790836.046620:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087552 00000100:00100000:3.0:1787790836.046635:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787790836.046640:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046670:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268087040:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.046675:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787790836.046685:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787790836.046690:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268087552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046740:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268087552:12345-0@lo:400:kworker.0 Request processed in 49us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.046745:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787790836.046765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086656 00000100:00100000:3.0:1787790836.046769:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086656 00000100:00100000:3.0:1787790836.046789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086528 00000100:00100000:3.0:1787790836.046791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086528 00000100:00100000:3.0:1787790836.046803:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787790836.046809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268086656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046842:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268086656:12345-0@lo:400:kworker.0 Request processed in 33us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.046848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787790836.046859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787790836.046865:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268086528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046900:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268086528:12345-0@lo:400:kworker.0 Request processed in 35us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.046905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787790836.046944:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4536d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268086528:0@lo:400:kworker.0 00010000:00080000:3.0:1787790836.046957:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b88b40 x1874634268087040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790836.046967:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268087040:0@lo:400:kworker.0 00010000:00080000:3.0:1787790836.046977:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4463c00 x1874634268087552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790836.046986:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268087552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.046995:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4535680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268086656:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.047004:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268087168:0@lo:400:kworker.0 00000100:00100000:3.0:1787790836.047013:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268087680:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047493:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268086272:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047571:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4534b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047618:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc389a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047657:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047722:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787790836.047730:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268086400:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047769:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047805:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268087424:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.047827:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.047882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086784 00000100:00100000:0.0:1787790836.047886:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086784 00000100:00100000:0.0:1787790836.047930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086400 00000100:00100000:0.0:1787790836.047934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086400 00000100:00100000:0.0:1787790836.047946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086912 00000100:00100000:0.0:1787790836.047949:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086912 00000100:00100000:0.0:1787790836.047963:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087424 00000100:00100000:0.0:1787790836.047966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087424 00000100:00100000:0.0:1787790836.047980:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787790836.047997:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268086784:12345-0@lo:400:kworker.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048039:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787790836.048054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787790836.048060:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268086400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048085:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268086400:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048091:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787790836.048102:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787790836.048107:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3089e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048131:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3089e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268086912:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048136:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787790836.048146:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787790836.048151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3088f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268087424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048174:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3088f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268087424:12345-0@lo:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048179:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787790836.048197:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087296 00000100:00100000:0.0:1787790836.048200:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087296 00000100:00100000:0.0:1787790836.048225:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087808 00000100:00100000:0.0:1787790836.048228:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087808 00000100:00100000:0.0:1787790836.048261:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787790836.048268:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268087296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048298:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268087296:12345-0@lo:400:kworker.0 Request processed in 31us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048310:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787790836.048481:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787790836.048488:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268087808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048518:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268087808:12345-0@lo:400:kworker.0 Request processed in 31us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048524:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787790836.048617:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268086400:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048628:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048638:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268087424:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048647:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4534b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048656:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc389a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048665:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787790836.048687:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790836.048696:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268087936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790836.048747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790836.048776:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268087936 00000100:00100000:0.0:1787790836.048779:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268087936 00000100:00100000:0.0:1787790836.048806:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787790836.048813:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268087936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790836.048835:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787790836.048878:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268087936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790836.048884:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787790836.048922:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268087936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790836.050338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268086272 00000100:00100000:2.0:1787790836.050347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268086272 00000100:00100000:2.0:1787790836.050396:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787790836.050404:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268086272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790836.050477:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268086272:12345-0@lo:400:kworker.0 Request processed in 74us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790836.050483:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:2.0:1787790836.050518:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787790836.050523:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790836.050527:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790836.050529:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790836.050561:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268086272:0@lo:400:kworker.0 00000100:00100000:2.0:1787790836.053146:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268088064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790836.053212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790836.053470:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268088064 00000100:00100000:3.0:1787790836.053478:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268088064 00000100:00100000:3.0:1787790836.053535:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787790836.053544:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268088064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787790836.053567:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787790836.053620:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268088064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790836.053627:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787790836.054198:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268088064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787790836.556262:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790837.189152:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189204:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189248:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189329:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189447:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790837.189485:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196352 00000100:00100000:1.0:1787790837.189498:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196352 00000100:00100000:1.0:1787790837.189575:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196864 00000100:00100000:1.0:1787790837.189579:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196864 00000100:00100000:1.0:1787790837.189597:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196480 00000100:00100000:1.0:1787790837.189600:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196480 00000100:00100000:1.0:1787790837.189614:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196992 00000100:00100000:1.0:1787790837.189617:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196992 00000100:00100000:1.0:1787790837.189636:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 291 00000100:00100000:1.0:1787790837.189648:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+14:2402:x1874634250196352:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790837.189776:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+14:2402:x1874634250196352:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 130us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790837.189923:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 291 00000100:00100000:3.0:1787790837.190010:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196608 00000100:00100000:3.0:1787790837.190015:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196608 00000100:00100000:3.0:1787790837.190067:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196736 00000100:00100000:3.0:1787790837.190070:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196736 00000100:00100000:3.0:1787790837.190095:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 108 00000100:00100000:3.0:1787790837.190103:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250196608:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790837.190139:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250196608:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 37us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790837.190145:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 108 00000100:00100000:3.0:1787790837.190158:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 109 00000100:00100000:3.0:1787790837.190165:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250196736:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790837.190187:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250196736:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790837.190194:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 109 00000100:00100000:2.0:1787790837.194891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 292 00000100:00100000:2.0:1787790837.194924:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2402:x1874634250196864:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790837.195050:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2402:x1874634250196864:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 142us (5800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790837.195061:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 292 00000100:00100000:2.0:1787790837.195112:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 293 00000100:00100000:2.0:1787790837.195121:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250196480:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790837.195151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250196480:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 33us (5842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790837.195158:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 293 00000100:00100000:2.0:1787790837.195172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 294 00000100:00100000:2.0:1787790837.195180:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250196992:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790837.195206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250196992:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790837.195212:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 294 00000100:00100000:1.0:1787790837.202505:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250196224 00000100:00100000:1.0:1787790837.202529:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250196224 00000100:00100000:1.0:1787790837.202619:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 383 00000100:00100000:1.0:1787790837.202630:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250196224:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790837.202760:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250196224:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 130us (13471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790837.202913:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 383 00000100:00080000:1.0:1787790837.202986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790837.202994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790837.203000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790837.203003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787790837.481771:0:14500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:33:57 (1787790837) 00010000:00010000:3.0:1787790837.579112:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787790838.092580:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1787790838.094289:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787790838.094312:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787790838.094451:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787790838.094467:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:0.0:1787790838.539586:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790838.539602:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790838.540204:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787790838.540224:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787790838.603097:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790838.604001:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790838.604132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790838.604511:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268088192 00000100:00100000:1.0:1787790838.604522:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268088192 00000100:00100000:1.0:1787790838.604607:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787790838.604620:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268088192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790838.604659:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790838.604765:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268088192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790838.604785:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787790838.605411:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790838.605430:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268088320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790838.605482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790838.605525:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268088320 00000100:00100000:0.0:1787790838.605529:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268088320 00000100:00100000:0.0:1787790838.605565:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787790838.605573:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268088320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790838.605589:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790838.605624:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268088320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790838.605631:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787790838.605694:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268088320:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787790838.606439:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790838.606494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790838.782757:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790838.782930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250197248 00000100:00100000:2.0:1787790838.782943:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250197248 00000100:00100000:2.0:1787790838.783024:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:2.0:1787790838.783037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+13:12145:x1874634250197248:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790838.783078:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790838.783109:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e3ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d6c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783207:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783266:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783288:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783295:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783301:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783429:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e3ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783438:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e3ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783445:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e3ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790838.783458:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787790838.783562:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783571:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783578:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783591:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790838.783597:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783606:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783621:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e15d8800) 00010000:00010000:2.0:1787790838.783625:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790838.783630:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783637:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e3f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783654:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783660:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783844:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783853:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790838.783856:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783864:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783883:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff916fc3702400) 00010000:00010000:2.0:1787790838.783885:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790838.783889:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.783895:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e3f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.786395:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1e3ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d6c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.786432:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e3ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d6c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.786444:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:2.0:1787790838.786448:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790838.786452:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994c00, rc 0) 00000100:00100000:2.0:1787790838.786567:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+15:12145:x1874634250197248:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 3530us (3876us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787790838.786578:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:1.0:1787790838.792992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790838.793128:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790838.793535:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250197504 00000100:00100000:2.0:1787790838.793550:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250197504 00000100:00100000:2.0:1787790838.793642:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:2.0:1787790838.793656:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+15:2402:x1874634250197504:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790838.793682:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790838.793760:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e3ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d6c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790838.793825:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:2.0:1787790838.793834:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790838.793928:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:2402:x1874634250197504:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 273us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790838.793937:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:0.0:1787790838.794662:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250197376 00000100:00100000:0.0:1787790838.794671:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250197376 00000100:00100000:0.0:1787790838.794763:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:0.0:1787790838.794781:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:12145:x1874634250197376:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787790838.795093:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:12145:x1874634250197376:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 313us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790838.795102:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:1.0:1787790838.799170:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790838.799307:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250197632 00000100:00100000:0.0:1787790838.799324:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250197632 00000100:00100000:0.0:1787790838.799500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 152 00000100:00100000:0.0:1787790838.799513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:12145:x1874634250197632:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787790838.799665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:12145:x1874634250197632:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 155us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790838.799674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 152 00000040:00080000:0.0:1787790838.925619:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787790839.563052:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790839.563065:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790839.563620:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787790839.563634:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790839.626988:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790839.627023:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268088448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790839.627136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790839.627287:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268088448 00000100:00100000:0.0:1787790839.627298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268088448 00000100:00100000:0.0:1787790839.627380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787790839.627393:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268088448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790839.627444:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790839.627505:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268088448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790839.627513:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787790839.627570:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268088448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790839.627902:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790839.627912:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268088576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790839.627948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790839.627978:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268088576 00000100:00100000:0.0:1787790839.627983:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268088576 00000100:00100000:0.0:1787790839.628007:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787790839.628013:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268088576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790839.628038:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787790839.628074:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268088576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790839.628080:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787790839.628127:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268088576:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787790839.630129:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790840.652329:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790840.748084:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790840.749853:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250197760 00000100:00100000:2.0:1787790840.749872:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250197760 00000100:00100000:2.0:1787790840.750031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 153 00000100:00100000:2.0:1787790840.750046:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+14:12187:x1874634250197760:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790840.750076:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790840.750106:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e40d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d73 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750206:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750226:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750240:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750260:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750268:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750289:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750348:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750357:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750364:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750371:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790840.750377:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750385:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750401:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:2.0:1787790840.750405:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790840.750412:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750420:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750438:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750445:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750458:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750478:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790840.750481:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750489:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750499:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff916fc3702400) 00010000:00010000:2.0:1787790840.750501:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790840.750505:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750511:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e41b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750553:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e40d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d73 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750566:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:2.0:1787790840.750569:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790840.750573:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e40d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d73 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.750583:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994800, rc 0) 00000100:00100000:2.0:1787790840.750693:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+14:12187:x1874634250197760:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 639us (2611us total) trans 0 rc 301/301 00000100:00100000:2.0:1787790840.750737:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 153 00000100:00080000:3.0:1787790840.754035:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790840.757185:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790840.757274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198016 00000100:00100000:2.0:1787790840.757288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198016 00000100:00100000:2.0:1787790840.757367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 154 00000100:00100000:2.0:1787790840.757379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+14:12187:x1874634250198016:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:2.0:1787790840.757456:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790840.757505:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1dd61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b97 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.757530:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:2.0:1787790840.757537:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790840.757613:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.757630:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.757640:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.757834:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.757852:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 5 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.757871:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268088704:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790840.758005:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3dec600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790840.763983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790840.764091:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198144 00000100:00100000:2.0:1787790840.764103:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198144 00010000:00010000:2.0:1787790840.764177:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 6 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790840.764236:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 81 00000100:00100000:2.0:1787790840.764248:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2403:x1874634250198144:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790840.764267:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790840.764275:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 6 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.764290:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 6 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.764318:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:2.0:1787790840.764325:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.764335:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.764345:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.764370:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790840.764438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2403:x1874634250198144:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 192us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790840.764447:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 81 00000100:00080000:3.0:1787790840.764799:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787790840.765305:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e3e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d65 expref: 5 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790840.765340:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268088704:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790840.765370:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.765381:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.765388:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.765417:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.765428:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.765438:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.766409:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.766429:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.766439:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790840.766456:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000590a068c reply state 000000007e385636 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.767860:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.767869:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790840.768531:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790840.768540:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787790840.768550:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787790840.768566:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768574:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768582:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768588:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790840.768593:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768601:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768615:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc36ffb00) 00010000:00010000:1.0:1787790840.768617:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790840.768621:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768628:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1e422 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790840.768663:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000590a068c reply state 000000007e385636 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768674:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.768816:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff916fc2690300) 00010000:00010000:1.0:1787790840.768819:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790840.768822:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787790840.769022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+15:12187:x1874634250198016:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 11638us (11842us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787790840.769034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 154 00000100:00100000:3.0:1787790840.847361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790840.849300:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198272 00000100:00100000:1.0:1787790840.849322:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198272 00000100:00100000:1.0:1787790840.849417:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 155 00000100:00100000:1.0:1787790840.849429:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+15:12195:x1874634250198272:12345-192.168.202.22@tcp:101:lctl.0 00010000:00010000:1.0:1787790840.849466:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790840.849496:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d7a expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.849589:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e43e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.849608:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.849622:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790840.849724:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787790840.849728:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790840.849759:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.849792:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d7a expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.849811:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e43e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d7a expref: 16 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790840.849820:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:1.0:1787790840.849823:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790840.849827:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fac00, rc 0) 00000100:00100000:1.0:1787790840.849919:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+16:12195:x1874634250198272:12345-192.168.202.22@tcp:101:lctl.0 Request processed in 492us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790840.849928:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 155 00000100:00100000:2.0:1787790840.915143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790840.915591:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198400 00000100:00100000:0.0:1787790840.915605:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198400 00000100:00100000:0.0:1787790840.915820:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 156 00000100:00100000:0.0:1787790840.915834:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+16:12201:x1874634250198400:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790840.915867:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790840.915896:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d81 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.915986:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916005:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916019:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916032:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916039:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916047:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916164:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1e45a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916173:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1e45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916213:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1e45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790840.916277:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787790840.916282:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790840.916311:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1e45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916326:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916332:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916341:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916347:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790840.916351:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916360:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916374:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:0.0:1787790840.916378:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790840.916383:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916391:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e44c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916419:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916426:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916432:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916437:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790840.916439:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916445:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916452:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff916fc2690300) 00010000:00010000:0.0:1787790840.916454:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790840.916456:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916475:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e453 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916505:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d81 expref: 18 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916520:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1e45a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d81 expref: 17 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.916539:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790840.916541:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787790840.916544:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4a00, rc 0) 00000100:00100000:0.0:1787790840.916638:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+17:12201:x1874634250198400:12345-192.168.202.22@tcp:101:bash.0 Request processed in 808us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.916646:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 156 00000100:00100000:1.0:1787790840.927371:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790840.927486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198656 00000100:00100000:2.0:1787790840.927497:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198656 00000100:00100000:2.0:1787790840.927569:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 157 00000100:00100000:2.0:1787790840.927580:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+17:12201:x1874634250198656:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790840.927604:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790840.927627:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e461 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.927799:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.927817:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.927828:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.927841:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.927847:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.927853:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790840.928180:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787790840.928328:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928338:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928360:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928395:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928403:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928410:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928416:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790840.928420:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928427:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928439:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790840.928442:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790840.928446:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928452:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e468 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790840.928464:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000913e5ad6 reply state 00000000cea02a63 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928474:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928487:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:2.0:1787790840.928489:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787790840.928491:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787790840.928518:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1e461 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928531:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.928538:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:2.0:1787790840.928540:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790840.928543:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790840.928605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+20:12201:x1874634250198656:12345-192.168.202.22@tcp:101:bash.0 Request processed in 1026us (1247us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787790840.928612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 157 00000100:00100000:2.0:1787790840.938307:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790840.939415:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198784 00000100:00100000:3.0:1787790840.939969:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198784 00000100:00100000:2.0:1787790840.940330:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:2.0:1787790840.940468:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250198784:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790840.940492:0:10092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790840.940517:0:10092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d8f expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790840.940543:0:10092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790840.940565:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1787790840.940570:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790840.940580:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 6 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.940615:0:10092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 6 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790840.940629:0:10092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995e00, rc 0) 00000100:00100000:2.0:1787790840.940699:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250198784:12345-192.168.202.22@tcp:101:bash.0 Request processed in 238us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790840.940739:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00080000:3.0:1787790840.940758:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790840.958842:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790840.959321:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250198912 00000100:00100000:0.0:1787790840.959332:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250198912 00000100:00100000:0.0:1787790840.959412:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:0.0:1787790840.959423:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+6:12201:x1874634250198912:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790840.959442:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790840.959466:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d96 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.959502:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.959512:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790840.959516:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790840.959522:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.959561:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.959599:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790840.959615:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1874634268088832:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790840.959762:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00ebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790840.963992:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1874634268088832:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790840.964035:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.964054:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5a00, rc 0) 00000100:00100000:0.0:1787790840.964155:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:12201:x1874634250198912:12345-192.168.202.22@tcp:101:bash.0 Request processed in 4734us (5325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.964165:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:2.0:1787790840.976247:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790840.976398:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250199040 00000100:00100000:0.0:1787790840.976408:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250199040 00010000:00010000:0.0:1787790840.976447:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790840.976488:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 82 00000100:00100000:0.0:1787790840.976497:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250199040:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790840.976512:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790840.976532:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.976565:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.976587:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027cffff/0xcf9477fddcf1e484 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d8f expref: 7 pid: 10092 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.976606:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790840.976610:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790840.976619:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.976629:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790840.976670:0:8442:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790840.976685:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8442:1874634268088960:192.168.202.22@tcp:105: 00000100:00100000:0.0:1787790840.976809:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00ebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790840.983059:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790840.983218:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc308b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8442:1874634268088960:192.168.202.22@tcp:105: 00010000:00010000:0.0:1787790840.983251:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790840.983316:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250199040:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 6818us (7078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790840.983328:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 82 00000100:00100000:1.0:1787790840.984105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250199296 00000100:00100000:1.0:1787790840.984115:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250199296 00000100:00100000:1.0:1787790840.984231:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:1.0:1787790840.984244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+20:12201:x1874634250199296:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:1.0:1787790840.984592:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:12201:x1874634250199296:12345-192.168.202.22@tcp:35:bash.0 Request processed in 349us (1543us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787790840.984600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:3.0:1787790841.061594:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790841.061762:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250199552 00000100:00100000:2.0:1787790841.061773:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250199552 00000100:00100000:2.0:1787790841.061847:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 158 00000100:00100000:2.0:1787790841.061868:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+21:12211:x1874634250199552:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790841.061898:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790841.061919:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223d9d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790841.062024:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787790841.062141:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e492 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d9d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.062156:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:2.0:1787790841.062159:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790841.062164:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d9d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.062208:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994800, rc 0) 00000100:00100000:2.0:1787790841.062277:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:12211:x1874634250199552:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 420us (702us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787790841.062284:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 158 00000100:00100000:3.0:1787790841.066389:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790841.066504:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250199808 00000100:00100000:2.0:1787790841.066519:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250199808 00000100:00100000:2.0:1787790841.066659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:2.0:1787790841.066672:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:12211:x1874634250199808:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790841.067078:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:12211:x1874634250199808:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 407us (705us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787790841.067092:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:3.0:1787790841.140813:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790841.140896:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250199936 00000100:00100000:0.0:1787790841.140910:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250199936 00000100:00100000:0.0:1787790841.140992:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 159 00000100:00100000:0.0:1787790841.141003:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:12217:x1874634250199936:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790841.141029:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790841.141050:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e4a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223da4 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.141112:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e4a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.141136:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.141150:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790841.141200:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787790841.141204:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790841.141220:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.141245:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e4a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223da4 expref: 25 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.141266:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223da4 expref: 24 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.141274:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790841.141277:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790841.141294:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4200, rc 0) 00000100:00100000:0.0:1787790841.141362:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+24:12217:x1874634250199936:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 360us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790841.141369:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 159 00000100:00100000:0.0:1787790841.145389:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.145484:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250200192 00000100:00100000:1.0:1787790841.145516:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250200192 00000100:00100000:1.0:1787790841.145582:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 160 00000100:00100000:1.0:1787790841.145593:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+24:12217:x1874634250200192:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790841.145612:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790841.145632:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e4ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dab expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.146247:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.146261:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.146273:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790841.146283:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787790841.146397:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e4ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dab expref: 27 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.146415:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dab expref: 26 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.146424:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:1.0:1787790841.146427:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790841.146430:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fae00, rc 0) 00000100:00100000:1.0:1787790841.146502:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+26:12217:x1874634250200192:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 911us (1123us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787790841.146510:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 160 00000100:00100000:2.0:1787790841.150939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790841.150981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.151101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250200448 00000100:00100000:1.0:1787790841.151111:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250200448 00000100:00100000:1.0:1787790841.151200:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 161 00000100:00100000:1.0:1787790841.151211:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+26:12217:x1874634250200448:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790841.151235:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790841.151258:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223db2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.151364:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e4ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.151380:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e4ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.151392:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e4ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790841.151405:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787790841.151514:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db2 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.151533:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e4ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db2 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.151543:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:1.0:1787790841.151546:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787790841.151550:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa000, rc 0) 00000100:00100000:1.0:1787790841.151617:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+28:12217:x1874634250200448:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 409us (689us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787790841.151651:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 161 00000100:00100000:3.0:1787790841.152302:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250200576 00000100:00100000:3.0:1787790841.152309:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250200576 00000100:00100000:3.0:1787790841.152354:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787790841.152363:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+28:2403:x1874634250200576:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790841.152377:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790841.152396:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e4b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dab expref: 28 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.152410:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:3.0:1787790841.152414:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790841.152457:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:2403:x1874634250200576:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 95us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.152465:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:2.0:1787790841.161441:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.163832:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790841.163869:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268089088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790841.163941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.164225:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268089216:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.164258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.164284:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc371e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268089728:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.164305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.164320:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268090240:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.164339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790841.164387:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268089600:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.164415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790841.164434:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268090112:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.164459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089600 00000100:00100000:1.0:1787790841.164465:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089600 00000100:00100000:1.0:1787790841.164508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787790841.164516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268089600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.164561:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268089600:12345-0@lo:400:kworker.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.164568:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787790841.164831:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268089472:0@lo:400:kworker.0 00000100:00100000:3.0:1787790841.164867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790841.164889:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268089984:0@lo:400:kworker.0 00000100:00100000:3.0:1787790841.164906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790841.164920:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268090496:0@lo:400:kworker.0 00000100:00100000:3.0:1787790841.164936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790841.164960:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089728 00000100:00100000:3.0:1787790841.164964:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089728 00000100:00100000:3.0:1787790841.164986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089984 00000100:00100000:3.0:1787790841.164988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089984 00000100:00100000:3.0:1787790841.165012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268090496 00000100:00100000:3.0:1787790841.165014:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268090496 00000100:00100000:3.0:1787790841.165024:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787790841.165029:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268089728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790841.165056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268089728:12345-0@lo:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.165063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787790841.165073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787790841.165078:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4537c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268089984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790841.165100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4537c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268089984:12345-0@lo:400:kworker.0 Request processed in 22us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.165105:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787790841.165113:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787790841.165118:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4535e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268090496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790841.165149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4535e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268090496:12345-0@lo:400:kworker.0 Request processed in 30us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.165168:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:3.0:1787790841.165183:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787790841.165219:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b90780 x1874634268089984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790841.165233:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268089984:0@lo:400:kworker.0 00010000:00080000:3.0:1787790841.165244:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc26bde00 x1874634268090496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790841.165251:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc26bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268090496:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.170943:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089472 00000100:00100000:1.0:1787790841.170958:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089472 00000100:00100000:1.0:1787790841.171028:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787790841.171040:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268089472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.171170:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268089472:12345-0@lo:400:kworker.0 Request processed in 133us (6302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.171178:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787790841.171246:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268089472:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.172210:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268090752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790841.172259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.172310:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc371e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268089728:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.172342:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787790841.172349:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268089344:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.172376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.172397:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268089856:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.172417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.172433:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268090368:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.172453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.172488:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089216 00000100:00100000:2.0:1787790841.172493:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089216 00000100:00100000:2.0:1787790841.172536:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787790841.172544:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268089216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.172587:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c4ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268089216:12345-0@lo:400:kworker.0 Request processed in 44us (8328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.172594:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787790841.172624:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089088 00000100:00100000:2.0:1787790841.172628:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089088 00000100:00100000:1.0:1787790841.172895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.172942:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268090752 00000100:00100000:2.0:1787790841.172946:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268090752 00000100:00100000:2.0:1787790841.172964:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787790841.172970:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4534b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268089088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790841.172991:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787790841.173029:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4534b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268089088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (9089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.173035:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787790841.173047:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787790841.173052:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268090752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787790841.173068:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787790841.173090:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268090752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.173095:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1787790841.173116:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790841.173152:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268090752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790841.173161:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268089216:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.173182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089344 00000100:00100000:2.0:1787790841.173185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089344 00000100:00100000:2.0:1787790841.173221:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268089856 00000100:00100000:2.0:1787790841.173223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268089856 00000100:00100000:2.0:1787790841.173237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268090368 00000100:00100000:2.0:1787790841.173240:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268090368 00000100:00100000:2.0:1787790841.173254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787790841.173260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268089344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.173294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268089344:12345-0@lo:400:kworker.0 Request processed in 34us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.173299:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787790841.173310:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787790841.173316:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268089856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.173340:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268089856:12345-0@lo:400:kworker.0 Request processed in 25us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.173346:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787790841.173356:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787790841.173362:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268090368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.173387:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268090368:12345-0@lo:400:kworker.0 Request processed in 26us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.173399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1787790841.173414:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790841.173430:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268089344:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.173440:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268089856:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.173448:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268090368:0@lo:400:kworker.0 00000100:00100000:0.0:1787790841.174514:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250200704 00000100:00100000:0.0:1787790841.174528:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250200704 00000100:00100000:0.0:1787790841.174580:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268090240 00000100:00100000:0.0:1787790841.174583:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268090240 00000100:00100000:0.0:1787790841.174616:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787790841.174625:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc389a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268090240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.174848:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787790841.174867:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+6:2403:x1874634250200704:12345-192.168.202.22@tcp:1:lfs.0 00010000:00010000:2.0:1787790841.174903:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.174926:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.174934:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787790841.174938:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790841.174943:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.174980:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.174994:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 6 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790841.175024:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1874634268090880:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790841.175112:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c55b0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790841.176053:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc389a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268090240:12345-0@lo:400:kworker.0 Request processed in 1424us (11707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790841.176065:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787790841.176110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790841.176255:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787790841.176261:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170c827b840, transno 4294967313 00000100:00100000:0.0:1787790841.176284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268089088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790841.178125:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268090624:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.178277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790841.178316:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268090112 00000100:00100000:1.0:1787790841.178324:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268090112 00000100:00100000:1.0:1787790841.178396:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268090624 00000100:00100000:1.0:1787790841.178414:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268090624 00000100:00100000:1.0:1787790841.178433:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787790841.178441:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268090112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.178492:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268090112:12345-0@lo:400:kworker.0 Request processed in 51us (5597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.178499:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787790841.178515:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787790841.178521:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268090624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.178547:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268090624:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.178552:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787790841.178567:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790841.178588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268090624:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.178613:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268089600:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.178620:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268090112:0@lo:400:kworker.0 00000100:00100000:2.0:1787790841.178912:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268090240:0@lo:400:kworker.0 00000100:00100000:1.0:1787790841.181423:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.182681:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250200832 00000100:00100000:3.0:1787790841.182695:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250200832 00002000:00100000:3.0:1787790841.182773:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff916fc37392c0 x1874634250200832/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:682/0 lens 504/0 e 0 to 0 dl 1787790852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787790841.182784:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc37392c0 with x1874634250200832 ext(0->12) 00010000:00010000:3.0:1787790841.182793:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 7 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.182810:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 7 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790841.182817:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc37392c0 00000100:00100000:2.0:1787790841.183090:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1874634268090880:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790841.183115:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790841.183241:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:3.0:1787790841.183253:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250200832:12345-192.168.202.22@tcp:4:lfs.0 00000100:00100000:3.0:1787790841.187268:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:2403:x1874634250200832:12345-192.168.202.22@tcp:4:lfs.0 Request processed in 4002us (5841us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787790841.187305:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00002000:00100000:3.0:1787790841.187321:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff916fc37392c0 x1874634250200832/t4294967306(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:682/0 lens 504/448 e 0 to 0 dl 1787790852 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787790841.187332:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc37392c0 with x1874634250200832 ext(0->12) 00010000:00010000:3.0:1787790841.187344:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 9 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.187365:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 9 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790841.187372:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc37392c0 00000100:00100000:2.0:1787790841.197948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.200328:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250200960 00000100:00100000:3.0:1787790841.200404:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250200960 00010000:00010000:3.0:1787790841.200462:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 9 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790841.200501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 83 00000100:00100000:3.0:1787790841.200511:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250200960:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790841.200530:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787790841.200549:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787790841.200552:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787790842 00002000:00010000:3.0:1787790841.200554:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787790842 00002000:00010000:3.0:1787790841.200556:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787790842 00002000:00010000:3.0:1787790841.200558:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787790841.200564:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 9 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.200593:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 9 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.200620:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ccfa3b/0xcf9477fddcf1e48b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d96 expref: 9 pid: 8427 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.201431:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790841.201438:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790841.201445:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.201457:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.203393:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790841.203488:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250200960:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 2970us (5655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790841.203502:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 83 00010000:00010000:1.0:1787790841.204800:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204819:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204875:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204908:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204918:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204926:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790841.204931:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204940:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204963:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.204970:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f77b71d/0xcf9477fddcf1e4d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790841.205085:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250200704:12345-192.168.202.22@tcp:1:lfs.0 Request processed in 30217us (43653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.205096:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787790841.211105:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.211253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250201216 00000100:00100000:1.0:1787790841.211263:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250201216 00000100:00100000:1.0:1787790841.211319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:1.0:1787790841.211355:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+27:12217:x1874634250201216:12345-192.168.202.22@tcp:35:lfs.0 00000004:00010000:1.0:1787790841.211423:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e4ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db2 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790841.211609:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787790841.211646:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787790841.212018:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787790841.212056:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.212071:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.212080:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.212114:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.212256:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 31 pid: 6514 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790841.212273:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874634268091008:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790841.212358:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790841.218998:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1874634268091008:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790841.219028:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790841.219583:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.219878:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250201344 00000100:00100000:3.0:1787790841.219887:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250201344 00010000:00010000:3.0:1787790841.219923:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 32 pid: 6514 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790841.219965:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 84 00000100:00100000:3.0:1787790841.219974:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+32:2402:x1874634250201344:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790841.219989:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790841.219996:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 32 pid: 6514 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.220025:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 32 pid: 6514 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.220048:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e476 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d88 expref: 32 pid: 6514 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.220064:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:3.0:1787790841.220069:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.220077:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.220085:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.220115:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790841.220184:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+31:2402:x1874634250201344:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 210us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.220202:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 84 00010000:00010000:1.0:1787790841.220754:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.220764:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787790841.220914:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787790841.221040:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787790841.221147:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268091136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787790841.221216:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790841.221244:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790841.221494:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268091136 00000100:00100000:0.0:1787790841.221501:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268091136 00000100:00100000:0.0:1787790841.221552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787790841.221561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874634268091136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787790841.221745:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874634268091136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 185us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790841.221753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787790841.222117:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268091136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787790841.222469:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787790841.222540:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45343c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268091264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787790841.222581:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790841.222987:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790841.229438:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268091264 00000100:00100000:0.0:1787790841.229456:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268091264 00000100:00100000:0.0:1787790841.229531:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787790841.229556:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4534780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1874634268091264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787790841.230150:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4534780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1874634268091264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 595us (7567us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787790841.230159:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787790841.235359:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45343c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1874634268091264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787790841.235462:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787790841.235525:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.235537:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.235546:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.235574:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790841.235579:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.235588:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.235603:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:2.0:1787790841.235606:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787790841.235611:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.235617:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e4df lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790841.235769:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787790841.235848:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787790841.236997:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390185289442ns, next at 391185283080ns, rc = 0 00000001:00080000:2.0:1787790841.237013:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1787790841.237066:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc3702d00) 00010000:00010000:2.0:1787790841.237071:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787790841.237080:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e4ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db2 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790841.237884:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+34:12217:x1874634250201216:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 26527us (26784us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1787790841.237896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00000020:00080000:2.0:1787790841.237902:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787790841.245629:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.245800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250201472 00000100:00100000:3.0:1787790841.245813:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250201472 00000100:00100000:3.0:1787790841.245989:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 162 00000100:00100000:3.0:1787790841.246020:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+34:12217:x1874634250201472:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790841.246055:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790841.246089:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e4e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.246173:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db9 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.246202:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db9 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.246226:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790841.246229:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790841.246234:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd39a00, rc 0) 00000100:00100000:3.0:1787790841.246327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+35:12217:x1874634250201472:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 308us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.246343:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 162 00000100:00100000:3.0:1787790841.249586:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790841.250163:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250201728 00000100:00100000:2.0:1787790841.250178:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250201728 00000100:00100000:2.0:1787790841.250283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:2.0:1787790841.250299:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4535680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+35:12217:x1874634250201728:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790841.250792:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4535680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+36:12217:x1874634250201728:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 496us (1221us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787790841.250801:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:0.0:1787790841.337899:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790841.338042:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250201984 00000100:00100000:2.0:1787790841.338055:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250201984 00000100:00100000:2.0:1787790841.338789:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 163 00000100:00100000:2.0:1787790841.338810:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c827b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+36:12227:x1874634250201984:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790841.338847:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790841.338886:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e4ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dc0 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790841.339025:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787790841.339232:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e4ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc0 expref: 38 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.339251:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:2.0:1787790841.339257:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790841.339263:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e4ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc0 expref: 38 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.339281:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995200, rc 0) 00000100:00100000:2.0:1787790841.339514:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c827b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+37:12227:x1874634250201984:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 710us (1631us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787790841.339543:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 163 00000100:00100000:0.0:1787790841.348766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.349046:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250202112 00000100:00100000:3.0:1787790841.349060:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250202112 00000100:00100000:3.0:1787790841.349216:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 164 00000100:00100000:3.0:1787790841.349230:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+37:12227:x1874634250202112:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:3.0:1787790841.349412:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349437:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349473:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349488:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349496:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349504:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349629:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349637:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.349644:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790841.350003:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350020:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350026:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350033:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350053:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790841.350058:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350066:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350081:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790841.350085:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790841.350090:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350096:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e4fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350114:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350119:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350125:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350130:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790841.350132:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350696:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350775:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:3.0:1787790841.350778:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790841.350783:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350791:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350813:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350820:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350828:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350835:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790841.350839:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350847:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350855:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790841.350858:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790841.350862:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.350868:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e509 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790841.351077:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+37:12227:x1874634250202112:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 1845us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.351090:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 164 00000100:00100000:2.0:1787790841.354627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.354882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250202368 00000100:00100000:1.0:1787790841.354898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250202368 00000100:00100000:1.0:1787790841.354995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:1.0:1787790841.355013:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+37:12227:x1874634250202368:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:1.0:1787790841.355300:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+38:12227:x1874634250202368:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 294us (693us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787790841.355309:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:0.0:1787790841.407898:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.408005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250202624 00000100:00100000:3.0:1787790841.408019:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250202624 00000100:00100000:3.0:1787790841.408106:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 165 00000100:00100000:3.0:1787790841.408120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:12230:x1874634250202624:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790841.408165:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790841.408206:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e510 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408350:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408373:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408389:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408403:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408412:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408419:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408603:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408613:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408621:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790841.408634:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787790841.408797:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408806:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408815:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408823:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790841.408829:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408838:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408854:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790841.408858:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790841.408864:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408882:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e517 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408899:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408905:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408910:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408915:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790841.408919:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408925:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408933:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:3.0:1787790841.408936:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790841.408939:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408946:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e51e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.408994:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e510 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.409008:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.409022:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790841.409025:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790841.409028:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38000, rc 0) 00000100:00100000:3.0:1787790841.409139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+40:12230:x1874634250202624:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1021us (1255us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787790841.409148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 165 00000100:00100000:1.0:1787790841.414069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790841.414253:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250202752 00000100:00100000:0.0:1787790841.414264:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250202752 00000100:00100000:0.0:1787790841.414338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787790841.414350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+40:12230:x1874634250202752:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:0.0:1787790841.414429:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414459:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414498:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414505:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414513:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414519:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790841.414538:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414546:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414560:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790841.414563:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790841.414568:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.414575:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e533 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790841.415027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+40:12230:x1874634250202752:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 678us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790841.415036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787790841.419959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.420104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250203008 00000100:00100000:1.0:1787790841.420114:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250203008 00000100:00100000:1.0:1787790841.420804:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:1.0:1787790841.420822:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+40:12230:x1874634250203008:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:1.0:1787790841.421344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+41:12230:x1874634250203008:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 522us (1387us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787790841.421353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00010000:00010000:2.0:1787790841.675481:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790841.706845:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.707411:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250203264 00000100:00100000:3.0:1787790841.707423:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250203264 00000100:00100000:3.0:1787790841.707491:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 167 00000100:00100000:3.0:1787790841.707503:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+41:12261:x1874634250203264:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:3.0:1787790841.707529:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790841.707553:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e53a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dce expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.707669:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.707684:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.707695:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790841.707726:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787790841.707945:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e53a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dce expref: 44 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.708003:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dce expref: 43 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.708012:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790841.708030:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790841.708034:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38200, rc 0) 00000100:00100000:3.0:1787790841.708131:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+43:12261:x1874634250203264:12345-192.168.202.22@tcp:101:cat.0 Request processed in 630us (1307us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787790841.708151:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 167 00000100:00100000:2.0:1787790841.712835:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.713236:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250203520 00000100:00100000:1.0:1787790841.713245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250203520 00000100:00100000:1.0:1787790841.713296:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:1.0:1787790841.713306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+43:12261:x1874634250203520:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:1.0:1787790841.713605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+44:12261:x1874634250203520:12345-192.168.202.22@tcp:35:cat.0 Request processed in 299us (794us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1787790841.713614:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:0.0:1787790841.725126:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790841.725220:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250203648 00000100:00100000:1.0:1787790841.725231:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250203648 00000100:00100000:1.0:1787790841.725312:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:1.0:1787790841.725324:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+44:2402:x1874634250203648:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790841.725357:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790841.725384:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e541 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dce expref: 44 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790841.725407:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790841.725412:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790841.725478:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+43:2402:x1874634250203648:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 156us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790841.725486:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:2.0:1787790841.780799:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.781004:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250203904 00000100:00100000:3.0:1787790841.781015:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250203904 00000100:00100000:3.0:1787790841.781087:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 168 00000100:00100000:3.0:1787790841.781097:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+43:12267:x1874634250203904:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787790841.781122:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790841.781125:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787790841.781152:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e4a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223da4 expref: 43 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.781174:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790841.781180:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790841.781208:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e54f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dd5 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.781325:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.781358:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.781367:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.781404:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.781418:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 43 pid: 6512 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790841.781433:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4536d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268091392:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790841.781520:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790841.784740:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4536d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268091392:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790841.784772:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790841.789897:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.790041:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250204032 00000100:00100000:3.0:1787790841.790054:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250204032 00010000:00010000:3.0:1787790841.790103:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 44 pid: 6512 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790841.790148:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 85 00000100:00100000:3.0:1787790841.790159:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+44:2403:x1874634250204032:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790841.790175:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790841.790193:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 44 pid: 6512 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.790209:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 44 pid: 6512 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.790253:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e525 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dc7 expref: 44 pid: 6512 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.790272:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790841.790277:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.790286:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.790294:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.790333:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790841.790404:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+43:2403:x1874634250204032:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 247us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790841.790413:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 85 00010000:00010000:2.0:1787790841.790526:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.790536:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790841.790556:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787790841.790701:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e54f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 44 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.790752:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 43 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790841.790761:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:2.0:1787790841.790765:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787790841.790767:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38800, rc 0) 00000100:00100000:2.0:1787790841.790794:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+43:12267:x1874634250203904:12345-192.168.202.22@tcp:101:dd.0 Request processed in 9699us (10006us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787790841.790809:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 168 00000100:00100000:3.0:1787790841.797889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790841.800516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250204160 00000100:00100000:0.0:1787790841.800777:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250204160 00000100:00100000:0.0:1787790841.800988:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 169 00000100:00100000:0.0:1787790841.801001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4536d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+43:12267:x1874634250204160:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:0.0:1787790841.801030:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790841.801054:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e564 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ddc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.801091:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.801126:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.801139:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.801288:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e564 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.801308:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790841.801318:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790841.801321:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790841.801325:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5800, rc 0) 00000100:00100000:0.0:1787790841.801412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4536d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+44:12267:x1874634250204160:12345-192.168.202.22@tcp:101:dd.0 Request processed in 414us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790841.801419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 169 00000100:00100000:1.0:1787790841.809237:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790841.812699:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250204416 00000100:00100000:3.0:1787790841.812789:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250204416 00000100:00100000:3.0:1787790841.813502:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 170 00000100:00100000:3.0:1787790841.813517:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+44:12267:x1874634250204416:12345-192.168.202.22@tcp:36:dd.0 00010000:00010000:3.0:1787790841.815190:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.815213:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.815227:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790841.815289:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1787790841.815314:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5ac3189 reply state 00000000ca1cbb21 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.815325:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790841.815333:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790841.815336:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790841.815340:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790841.815489:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+47:12267:x1874634250204416:12345-192.168.202.22@tcp:36:dd.0 Request processed in 1974us (6259us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1787790841.815499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 170 00000020:00080000:3.0:1787790841.815504:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787790842.252553:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790842.252651:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250204544 00000100:00100000:3.0:1787790842.252662:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250204544 00000100:00100000:3.0:1787790842.252771:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 171 00000100:00100000:3.0:1787790842.252783:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+47:12281:x1874634250204544:12345-192.168.202.22@tcp:101:stat.0 00010000:00010000:3.0:1787790842.252811:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790842.252845:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e579 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223de3 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.252929:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.252944:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.252959:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.252988:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.252996:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.253003:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.253074:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.253084:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 48 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.253093:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.253127:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 48 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.253142:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 48 pid: 10093 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790842.253156:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45370c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268091520:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790842.253299:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00080000:1.0:1787790842.253952:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790842.257651:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790842.257743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250204800 00000100:00100000:1.0:1787790842.257752:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250204800 00000100:00100000:1.0:1787790842.257810:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:1.0:1787790842.257835:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+49:6168:x1874634250204800:12345-192.168.202.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787790842.258127:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+50:6168:x1874634250204800:12345-192.168.202.22@tcp:35:ldlm_bl.0 Request processed in 308us (486us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787790842.258134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:3.0:1787790842.258698:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45370c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268091520:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790842.258751:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790842.262094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790842.262270:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250204928 00000100:00100000:1.0:1787790842.262280:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250204928 00010000:00010000:1.0:1787790842.262323:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 50 pid: 10093 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790842.262433:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00100000:1.0:1787790842.262444:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+50:2400:x1874634250204928:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790842.262463:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790842.262471:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 50 pid: 10093 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.262483:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 50 pid: 10093 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.262505:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e556 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dd5 expref: 50 pid: 10093 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.262522:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790842.262528:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.262537:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.262563:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.262596:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790842.262659:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+49:2400:x1874634250204928:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 216us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790842.262666:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 86 00010000:00010000:3.0:1787790842.263671:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263682:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790842.263768:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787790842.263774:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787790842.263801:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263830:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263842:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263858:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263866:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263872:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790842.263876:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263885:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263898:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790842.263911:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790842.263917:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263923:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e580 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263937:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263943:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263950:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263955:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790842.263958:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263964:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263972:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:3.0:1787790842.263975:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790842.263978:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.263983:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.264018:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e579 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223de3 expref: 49 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.264048:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223de3 expref: 48 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.264055:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790842.264058:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790842.264061:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e0e00, rc 0) 00000100:00100000:3.0:1787790842.264123:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+48:12281:x1874634250204544:12345-192.168.202.22@tcp:101:stat.0 Request processed in 11343us (11581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790842.264132:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 171 00000100:00100000:2.0:1787790842.314646:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.314692:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.314771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.314819:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.314854:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.314893:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.314924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205568 00000100:00100000:2.0:1787790842.314935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205568 00000100:00100000:2.0:1787790842.314991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205184 00000100:00100000:2.0:1787790842.314995:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205184 00000100:00100000:2.0:1787790842.315014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205696 00000100:00100000:2.0:1787790842.315017:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205696 00000100:00100000:2.0:1787790842.315035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 301 00000100:00100000:2.0:1787790842.315045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250205568:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790842.315389:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250205568:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 344us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790842.315398:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 301 00000100:00100000:2.0:1787790842.315421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 302 00000100:00100000:2.0:1787790842.315427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250205184:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790842.315454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2401:x1874634250205184:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790842.315461:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 302 00000100:00100000:2.0:1787790842.315474:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 303 00000100:00100000:2.0:1787790842.315489:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250205696:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790842.315515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2401:x1874634250205696:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790842.315521:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 303 00000100:00080000:2.0:1787790842.315540:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790842.315543:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790842.318458:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205056 00000100:00100000:1.0:1787790842.318474:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205056 00000100:00100000:1.0:1787790842.318548:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 385 00000100:00100000:1.0:1787790842.318559:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250205056:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790842.318650:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250205056:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 92us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790842.318658:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 385 00000100:00100000:0.0:1787790842.318753:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205312 00000100:00100000:0.0:1787790842.318758:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205312 00000100:00100000:1.0:1787790842.318792:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205440 00000100:00100000:1.0:1787790842.318796:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205440 00000100:00100000:0.0:1787790842.318811:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 113 00000100:00100000:0.0:1787790842.318818:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc371e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250205312:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790842.318849:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc371e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250205312:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 32us (4157us total) trans 0 rc 0/0 00000100:00080000:2.0:1787790842.318852:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787790842.318856:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790842.322388:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 114 00000100:00100000:1.0:1787790842.322411:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250205440:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790842.322973:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+6:2401:x1874634250205440:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 571us (8114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790842.322983:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 114 00000100:00100000:0.0:1787790842.334654:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 113 00000100:00100000:2.0:1787790842.343827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790842.344031:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250205952 00000100:00100000:0.0:1787790842.344056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250205952 00000100:00100000:0.0:1787790842.344115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 172 00000100:00100000:0.0:1787790842.344126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+48:12287:x1874634250205952:12345-192.168.202.22@tcp:36:truncate.0 00010000:00010000:0.0:1787790842.344192:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790842.344222:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e58e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223de3 expref: 48 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.344243:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790842.344249:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790842.344435:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.344449:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.344460:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790842.344502:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787790842.344524:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd8a6a98 reply state 000000003465b764 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.344537:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.344544:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790842.344546:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790842.344550:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790842.344652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+50:12287:x1874634250205952:12345-192.168.202.22@tcp:36:truncate.0 Request processed in 528us (834us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787790842.344660:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 172 00000020:00080000:0.0:1787790842.344674:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787790842.507502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790842.507646:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250206080 00000100:00100000:0.0:1787790842.507657:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250206080 00000100:00100000:0.0:1787790842.507759:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 173 00000100:00100000:0.0:1787790842.507771:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+50:12301:x1874634250206080:12345-192.168.202.22@tcp:101:stat.0 00010000:00010000:0.0:1787790842.507797:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790842.507833:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e59c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.507904:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.507919:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.507930:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.507942:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.507949:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.507956:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508036:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508045:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508071:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790842.508110:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787790842.508114:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790842.508133:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508145:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508153:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508159:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508165:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508171:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790842.508174:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508193:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508205:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790842.508207:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790842.508211:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508227:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508244:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508251:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508256:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508261:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790842.508264:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508270:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508278:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:0.0:1787790842.508281:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790842.508284:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508290:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508529:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e59c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508545:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.508558:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790842.508560:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790842.508563:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4600, rc 0) 00000100:00100000:0.0:1787790842.508632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+51:12301:x1874634250206080:12345-192.168.202.22@tcp:101:stat.0 Request processed in 863us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790842.508640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 173 00000100:00100000:3.0:1787790842.609071:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790842.610426:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250206336 00000100:00100000:1.0:1787790842.610441:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250206336 00000100:00100000:1.0:1787790842.610564:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 174 00000100:00100000:1.0:1787790842.610575:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+51:12311:x1874634250206336:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790842.610615:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790842.610635:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e5b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223df1 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790842.610770:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787790842.610885:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e5b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df1 expref: 53 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.610902:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:1.0:1787790842.610906:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790842.610911:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e5b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df1 expref: 53 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.610927:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb000, rc 0) 00000100:00100000:1.0:1787790842.611007:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+52:12311:x1874634250206336:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 433us (1950us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1787790842.611014:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 174 00000100:00100000:1.0:1787790842.617518:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.617617:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250206592 00000100:00100000:2.0:1787790842.617629:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250206592 00000100:00100000:2.0:1787790842.617689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:2.0:1787790842.617723:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+52:12311:x1874634250206592:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790842.617940:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+53:12311:x1874634250206592:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 237us (432us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787790842.617948:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:3.0:1787790842.686855:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.686969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250206848 00000100:00100000:2.0:1787790842.686979:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250206848 00000100:00100000:2.0:1787790842.687045:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 175 00000100:00100000:2.0:1787790842.687057:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4535680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+53:12317:x1874634250206848:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790842.687086:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790842.687112:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e5c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223df8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.687239:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.687274:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.687285:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.687333:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.687344:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 54 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790842.687355:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268091648:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790842.687428:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790842.691696:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268091648:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790842.691766:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790842.696219:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.697216:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250206976 00000100:00100000:2.0:1787790842.697229:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250206976 00010000:00010000:2.0:1787790842.697281:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 55 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790842.698264:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 87 00000100:00100000:2.0:1787790842.698282:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+55:2403:x1874634250206976:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790842.698300:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790842.698332:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 55 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.698346:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 55 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.698369:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e5b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dea expref: 55 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.698388:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:2.0:1787790842.698395:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.698405:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.698413:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.698448:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790842.698519:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+54:2403:x1874634250206976:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 243us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790842.698528:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 87 00010000:00010000:3.0:1787790842.698604:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.698612:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790842.698632:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787790842.698792:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e5c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.698807:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.698814:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790842.698837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790842.698840:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994800, rc 0) 00000100:00100000:3.0:1787790842.698875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4535680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+54:12317:x1874634250206848:12345-192.168.202.22@tcp:101:bash.0 Request processed in 11820us (12030us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787790842.698882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 175 00010000:00010000:1.0:1787790842.703019:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790842.703694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790842.704417:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250207232 00000100:00100000:0.0:1787790842.704428:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250207232 00000100:00100000:0.0:1787790842.704517:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 176 00000100:00100000:0.0:1787790842.704529:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc26bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+54:12317:x1874634250207232:12345-192.168.202.22@tcp:36:bash.0 00010000:00010000:0.0:1787790842.704820:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.705240:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.705253:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790842.705304:0:10093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787790842.705330:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004cf421b reply state 00000000f014e336 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.705344:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.705352:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790842.705355:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790842.705375:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790842.705493:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc26bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+57:12317:x1874634250207232:12345-192.168.202.22@tcp:36:bash.0 Request processed in 963us (1804us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787790842.705501:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 176 00000020:00080000:0.0:1787790842.705506:0:10093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787790842.715222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790842.715396:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250207360 00000100:00100000:0.0:1787790842.715406:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250207360 00000100:00100000:0.0:1787790842.715504:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 177 00000100:00100000:0.0:1787790842.715515:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+57:12317:x1874634250207360:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790842.715537:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790842.715557:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223dff expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.715652:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.715667:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.715677:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.715749:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.715765:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 58 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790842.715779:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268091776:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790842.715988:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00ebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790842.723433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.723550:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250207488 00000100:00100000:2.0:1787790842.723560:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250207488 00010000:00010000:2.0:1787790842.723601:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 59 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790842.723646:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 88 00000100:00100000:2.0:1787790842.723656:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+59:2402:x1874634250207488:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790842.723685:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790842.723693:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 59 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.723743:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 59 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.723777:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:2.0:1787790842.723783:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.723793:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.723801:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.724122:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790842.724190:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+59:2402:x1874634250207488:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 522us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790842.724199:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 88 00010000:00010000:0.0:1787790842.724698:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e5cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223df8 expref: 58 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790842.724739:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268091776:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790842.724841:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.725072:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.725080:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790842.725131:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787790842.725144:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790842.725163:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.725204:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e5e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dff expref: 58 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.725219:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dff expref: 57 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.725226:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790842.725229:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790842.725231:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5200, rc 0) 00000100:00100000:1.0:1787790842.725282:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+57:12317:x1874634250207360:12345-192.168.202.22@tcp:101:bash.0 Request processed in 9769us (10070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790842.725289:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 177 00000100:00100000:1.0:1787790842.728639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.728701:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250207744 00000100:00100000:2.0:1787790842.728815:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250207744 00000100:00100000:2.0:1787790842.728919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:2.0:1787790842.728930:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+57:12317:x1874634250207744:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:2.0:1787790842.729155:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+58:12317:x1874634250207744:12345-192.168.202.22@tcp:35:bash.0 Request processed in 226us (522us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787790842.729163:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:2.0:1787790842.846437:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790842.846565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250208000 00000100:00100000:3.0:1787790842.846575:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250208000 00000100:00100000:3.0:1787790842.846640:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 178 00000100:00100000:3.0:1787790842.846650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+58:12327:x1874634250208000:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790842.846675:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790842.846699:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e5f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790842.846837:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787790842.846951:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e5f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e06 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.846965:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:3.0:1787790842.846968:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790842.846973:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e1000/0xcf9477fddcf1e5f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e06 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790842.846988:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c29e1000, rc 0) 00000100:00100000:3.0:1787790842.847058:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+59:12327:x1874634250208000:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 410us (635us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1787790842.847065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 178 00000100:00100000:3.0:1787790842.854572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790842.854777:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250208128 00000100:00100000:0.0:1787790842.854788:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250208128 00000100:00100000:0.0:1787790842.854847:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 179 00000100:00100000:0.0:1787790842.854965:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+59:12327:x1874634250208128:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:0.0:1787790842.855048:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855067:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855079:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855091:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855099:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855106:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855209:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855219:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855225:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790842.855271:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855284:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855290:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855297:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855304:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790842.855308:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855327:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855341:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790842.855344:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790842.855350:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855363:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4e00/0xcf9477fddcf1e5fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855378:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855384:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855390:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855395:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790842.855398:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855404:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855412:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:0.0:1787790842.855415:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790842.855418:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855424:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e605 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855434:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855439:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855450:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855455:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790842.855458:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855465:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855473:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790842.855475:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790842.855478:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790842.855484:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e60c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790842.855684:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+59:12327:x1874634250208128:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 826us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790842.855694:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 179 00000100:00100000:1.0:1787790842.869043:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790842.869133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250208384 00000100:00100000:0.0:1787790842.869144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250208384 00000100:00100000:0.0:1787790842.869223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:0.0:1787790842.869236:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+59:12327:x1874634250208384:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790842.869496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+60:12327:x1874634250208384:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 262us (467us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787790842.869505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:2.0:1787790842.941003:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790842.941379:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250208640 00000100:00100000:1.0:1787790842.941391:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250208640 00000100:00100000:1.0:1787790842.941509:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 180 00000100:00100000:1.0:1787790842.941522:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+60:12331:x1874634250208640:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790842.941546:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790842.941580:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e613 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e0d expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.941655:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.941700:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.941741:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.941755:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.941763:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.941769:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942154:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942166:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942185:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790842.942196:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787790842.942277:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942285:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942291:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942305:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790842.942310:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942318:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942330:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790842.942333:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790842.942338:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942344:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942357:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942363:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942369:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942374:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790842.942376:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942383:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942398:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:1.0:1787790842.942401:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790842.942403:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942409:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942446:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e613 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e0d expref: 63 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942460:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e0d expref: 62 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.942466:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790842.942469:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790842.942472:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa800, rc 0) 00000100:00100000:1.0:1787790842.942605:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+62:12331:x1874634250208640:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1025us (1551us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787790842.942617:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 180 00000100:00100000:3.0:1787790842.947052:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790842.948042:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.949291:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250208768 00000100:00100000:2.0:1787790842.949309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250208768 00000100:00100000:2.0:1787790842.949405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 181 00000100:00100000:2.0:1787790842.949416:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+62:12331:x1874634250208768:12345-192.168.202.22@tcp:54:lfs.0 00000100:00100000:1.0:1787790842.949493:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250208896 00010000:00010000:2.0:1787790842.949495:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790842.949498:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250208896 00010000:00010000:2.0:1787790842.949515:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.949527:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790842.949542:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:1.0:1787790842.949559:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+63:2401:x1874634250208896:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790842.949564:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.949570:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790842.949571:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.949577:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.949593:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e0d expref: 63 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790842.952459:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790842.952474:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790842.952667:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+62:2401:x1874634250208896:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 3104us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790842.952679:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00010000:00010000:2.0:1787790842.955201:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790842.955220:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.955237:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.955259:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:2.0:1787790842.955280:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790842.955287:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790842.955295:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e636 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790842.955401:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+61:12331:x1874634250208768:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 5981us (8362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790842.955412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 181 00000100:00100000:3.0:1787790842.958967:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790842.959220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250209152 00000100:00100000:2.0:1787790842.959232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250209152 00000100:00100000:2.0:1787790842.959303:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:2.0:1787790842.959315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+61:12331:x1874634250209152:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790842.959598:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+62:12331:x1874634250209152:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 284us (897us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787790842.959606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:3.0:1787790843.100839:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.102186:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250209408 00000100:00100000:0.0:1787790843.102206:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250209408 00000100:00100000:1.0:1787790843.102510:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 182 00000100:00100000:1.0:1787790843.102523:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+62:12349:x1874634250209408:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:1.0:1787790843.102562:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790843.102593:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e63d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e14 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.102765:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e644 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.102784:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e644 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.102799:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e644 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790843.103476:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787790843.103655:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e63d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e14 expref: 65 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.103680:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e644 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e14 expref: 64 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.103804:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790843.103807:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787790843.103824:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa600, rc 0) 00000100:00100000:1.0:1787790843.103933:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+64:12349:x1874634250209408:12345-192.168.202.22@tcp:101:cat.0 Request processed in 1411us (3123us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787790843.103943:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 182 00000100:00100000:3.0:1787790843.129763:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790843.130517:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250209536 00000100:00100000:1.0:1787790843.130535:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250209536 00000100:00100000:1.0:1787790843.130629:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 183 00000100:00100000:1.0:1787790843.130643:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+64:12350:x1874634250209536:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790843.130678:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790843.130755:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e1b expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.131462:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e659 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.131486:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.131501:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790843.131566:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787790843.131571:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790843.131598:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.131661:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e1b expref: 66 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.131690:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e659 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e1b expref: 65 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.131700:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790843.131806:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790843.131823:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994e00, rc 0) 00000100:00100000:2.0:1787790843.132121:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+65:12350:x1874634250209536:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1478us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.132132:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 183 00000100:00100000:3.0:1787790843.139279:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.139424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250209920 00000100:00100000:2.0:1787790843.139438:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250209920 00000100:00100000:2.0:1787790843.139527:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:2.0:1787790843.139542:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+65:12350:x1874634250209920:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787790843.141282:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+66:12350:x1874634250209920:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 1728us (2006us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787790843.141422:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:3.0:1787790843.143939:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.144753:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210048 00000100:00100000:2.0:1787790843.144769:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210048 00000100:00100000:2.0:1787790843.144893:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:2.0:1787790843.144908:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+66:12350:x1874634250210048:12345-192.168.202.22@tcp:103:lfs.0 00010000:00010000:2.0:1787790843.144928:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787790843.144963:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e5e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223dff expref: 66 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.145208:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e644 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e14 expref: 65 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.145230:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e4e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223db9 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.145243:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:2.0:1787790843.145251:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790843.145482:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+63:12350:x1874634250210048:12345-192.168.202.22@tcp:103:lfs.0 Request processed in 575us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.145492:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:3.0:1787790843.148839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.149028:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210176 00000100:00100000:2.0:1787790843.149040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210176 00000100:00100000:2.0:1787790843.149115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 184 00000100:00100000:2.0:1787790843.149127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+63:12350:x1874634250210176:12345-192.168.202.22@tcp:58:lfs.0 00010000:00010000:2.0:1787790843.149354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.149380:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.149396:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790843.149553:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787790843.149672:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+63:12350:x1874634250210176:12345-192.168.202.22@tcp:58:lfs.0 Request processed in 546us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.149692:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 184 00000100:00100000:3.0:1787790843.179129:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790843.179339:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210304 00000100:00100000:1.0:1787790843.179352:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210304 00000100:00100000:1.0:1787790843.179429:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 185 00000100:00100000:1.0:1787790843.179441:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+63:12352:x1874634250210304:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790843.179467:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790843.179494:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e667 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e22 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179586:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179605:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179639:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179653:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179660:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179667:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179832:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179844:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179851:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790843.179910:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787790843.179915:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790843.179941:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179957:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179966:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179984:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179992:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.179998:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fba00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790843.180003:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180023:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180038:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790843.180042:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790843.180047:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180054:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e66e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180070:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180075:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180081:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180086:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790843.180095:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180102:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180110:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:1.0:1787790843.180113:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790843.180117:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180123:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e675 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180157:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e667 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 65 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180184:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 64 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.180192:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790843.180195:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790843.180198:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa600, rc 0) 00000100:00100000:1.0:1787790843.180284:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+64:12352:x1874634250210304:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 845us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790843.180293:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 185 00000040:00080000:0.0:1787790843.660877:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790843.660887:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790843.660947:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787790843.660953:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790843.661122:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170d11c92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268091904:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790843.661264:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790843.671072:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.671151:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170d11c92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268091904:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787790843.672303:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210432 00000100:00100000:2.0:1787790843.672320:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210432 00000100:00100000:2.0:1787790843.672402:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 186 00000100:00100000:2.0:1787790843.672415:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+64:12363:x1874634250210432:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787790843.672457:0:10094:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787790843.673007:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+64:12363:x1874634250210432:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 592us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.673018:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 186 00000001:00080000:2.0:1787790843.675688:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1787790843.675789:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787790843.675827:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170fc226540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787790843.675833:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff916fc3476400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170fc226c00 00000020:00080000:2.0:1787790843.675836:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff916fc3476500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff917101134c00 00000020:00080000:2.0:1787790843.675893:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787790843.675976:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787790843.677910:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790843.677937:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268092032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787790843.678037:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790843.678107:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268092032 00000100:00100000:3.0:1787790843.678115:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268092032 00000100:00100000:3.0:1787790843.678197:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787790843.678214:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268092032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787790843.678250:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1787790843.678307:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f85fa, atime: 0x6a8f85fa, ctime: 0x6a8f85fa, blocks: 0x8 00010000:00010000:3.0:1787790843.678316:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.678336:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1787790843.678341:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790843.678348:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.678367:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.678400:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.678409:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.678430:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790843.678738:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678750:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678757:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678764:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26faa00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.678769:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678786:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678806:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff916fc2690300) 00010000:00010000:0.0:1787790843.678810:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.678816:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678835:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e429 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678871:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678878:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678884:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678890:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.678894:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678900:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678908:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790843.678911:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.678914:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.678921:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e430 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.679228:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1874634268092032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1020us (1188us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787790843.679238:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787790843.679274:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787790843.679293:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679302:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679303:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790843.679310:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679319:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790843.679323:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679331:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679347:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679367:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eafbb9e/0xcf9477fddcf1e683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679387:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790843.679389:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790843.679391:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790843.679423:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679429:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.679432:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679438:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679447:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3702400) 00010000:00010000:0.0:1787790843.679449:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.679452:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679458:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e46f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679475:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679482:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679487:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679492:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.679495:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679511:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.679515:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00010000:00010000:0.0:1787790843.679521:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790843.679523:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.679527:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679532:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38000/0xcf9477fddcf1e572 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.679545:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210560 00010000:00010000:0.0:1787790843.679545:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679550:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.679551:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210560 00010000:00010000:0.0:1787790843.679556:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679561:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.679564:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679569:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679576:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790843.679578:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.679581:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.679589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 187 00010000:00010000:0.0:1787790843.679596:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e595 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.679597:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250210560:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787790843.679609:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679615:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679620:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679625:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.679628:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679633:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679641:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790843.679643:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.679645:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.679650:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e5db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679671:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679685:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679695:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679734:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679741:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679748:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679794:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679804:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679812:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790843.679881:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787790843.679887:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787790843.679903:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679913:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679917:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679921:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679924:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e0e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790843.679926:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679929:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679935:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:3.0:1787790843.679941:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790843.679946:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679952:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c29e0e00/0xcf9477fddcf1e68a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679964:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679970:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679976:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679981:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd39a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790843.679983:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679989:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.679996:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9170e58dd000) 00010000:00010000:3.0:1787790843.679998:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790843.680001:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680005:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39a00/0xcf9477fddcf1e691 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680018:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680029:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680034:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680040:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790843.680043:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680050:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680058:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790843.680060:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790843.680063:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.680069:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38800/0xcf9477fddcf1e698 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.680144:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+17:12363:x1874634250210560:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 546us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.680152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 187 00000004:00080000:3.0:1787790843.680227:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff916fc3b16580/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787790843.680236:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268092032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787790843.689632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.690055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210816 00000100:00100000:3.0:1787790843.690068:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210816 00000100:00100000:3.0:1787790843.690192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 188 00000100:00100000:3.0:1787790843.690214:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d11c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+17:12363:x1874634250210816:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790843.690245:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790843.690277:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e69f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e29 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690628:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690649:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690664:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790843.690678:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787790843.690811:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690894:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690902:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690909:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790843.690915:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690924:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690940:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:3.0:1787790843.690950:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790843.690958:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.690964:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38200/0xcf9477fddcf1e6a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.691016:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e69f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e29 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.691029:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:3.0:1787790843.691032:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790843.691036:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd38400/0xcf9477fddcf1e69f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e29 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.691047:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd38400, rc 0) 00000100:00100000:3.0:1787790843.691131:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d11c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:12363:x1874634250210816:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 921us (1507us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1787790843.691140:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 188 00000100:00100000:1.0:1787790843.702372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.702505:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250210944 00000100:00100000:3.0:1787790843.702519:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250210944 00000100:00100000:3.0:1787790843.702605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 189 00000100:00100000:3.0:1787790843.702619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+18:12363:x1874634250210944:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787790843.702670:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787790843.702892:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+18:12363:x1874634250210944:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 275us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.702902:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 189 00000100:00100000:3.0:1787790843.714898:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790843.715102:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250211200 00000100:00100000:1.0:1787790843.715116:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250211200 00000100:00100000:1.0:1787790843.715209:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 190 00000100:00100000:1.0:1787790843.715231:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+18:12363:x1874634250211200:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790843.715258:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790843.715261:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787790843.715310:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1e659 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e1b expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.715341:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790843.715347:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790843.715366:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e6b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e30 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790843.715975:0:10093:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787790843.716176:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e6bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.716195:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.716207:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.716278:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e6b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e30 expref: 20 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.716294:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e6bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e30 expref: 19 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.716302:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc2690a00) 00010000:00010000:1.0:1787790843.716306:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790843.716321:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fae00, rc 0) 00000100:00100000:1.0:1787790843.716420:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250211200:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1192us (1537us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787790843.716430:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 190 00010000:00010000:2.0:1787790843.722865:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790843.723179:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790843.723211:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268092160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790843.723325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790843.723493:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268092160 00000100:00100000:0.0:1787790843.723504:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268092160 00000100:00100000:0.0:1787790843.723589:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787790843.723608:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268092160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790843.723648:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787790843.723729:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268092160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.723737:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1787790843.724157:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790843.724217:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268092160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790843.728773:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.728850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250211456 00000100:00100000:2.0:1787790843.728864:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250211456 00000100:00100000:2.0:1787790843.728961:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 191 00000100:00100000:2.0:1787790843.728975:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250211456:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790843.729058:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790843.729095:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e6bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e30 expref: 19 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729117:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc2690a00) 00010000:00010000:2.0:1787790843.729131:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790843.729176:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729195:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729209:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729560:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729587:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729600:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729660:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729668:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729694:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790843.729749:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787790843.729755:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790843.729764:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790843.729774:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268092288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790843.729775:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729801:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790843.729804:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790843.729809:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729816:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e6c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729902:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729963:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.729972:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790843.729974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790843.729987:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790843.729991:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.730010:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.730022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe1270155 (ffff916fc3702700) 00010000:00010000:2.0:1787790843.730024:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790843.730027:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.730034:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1e6d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe1270155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790843.730178:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:12363:x1874634250211456:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1191us (1410us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790843.730189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 191 00000100:00100000:0.0:1787790843.730561:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268092288 00000100:00100000:0.0:1787790843.730570:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268092288 00000100:00100000:0.0:1787790843.730627:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787790843.730637:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268092288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790843.730661:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787790843.730750:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268092288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.730757:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787790843.731013:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268092288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790843.734519:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.736018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250211584 00000100:00100000:2.0:1787790843.736033:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250211584 00000100:00100000:2.0:1787790843.736096:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 192 00000100:00100000:2.0:1787790843.736107:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:12363:x1874634250211584:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790843.736126:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790843.736148:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e6d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e37 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.736198:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.736215:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.736230:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.736364:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e6d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.736389:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.736399:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:2.0:1787790843.736402:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790843.736406:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790843.736480:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250211584:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 374us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.736489:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 192 00000100:00100000:3.0:1787790843.741488:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.741606:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250211840 00000100:00100000:0.0:1787790843.741622:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250211840 00000100:00100000:0.0:1787790843.741834:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 193 00000100:00100000:0.0:1787790843.741847:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250211840:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790843.741990:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.742014:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.742029:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787790843.743261:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787790843.743289:0:10094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392691583140ns, next at 393691576805ns, rc = 0 00000004:00010000:0.0:1787790843.743401:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000184ad7c8 reply state 0000000090ae11eb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.743426:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.743435:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:0.0:1787790843.743439:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787790843.743445:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790843.743614:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+21:12363:x1874634250211840:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1765us (2140us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787790843.743626:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 193 00000100:00100000:2.0:1787790843.746923:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.747018:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250211968 00000100:00100000:3.0:1787790843.747031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250211968 00000100:00100000:3.0:1787790843.747104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 194 00000100:00100000:3.0:1787790843.747115:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+21:12363:x1874634250211968:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790843.747148:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790843.747188:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e3e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.747267:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.747280:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.747304:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:3.0:1787790843.747308:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790843.747322:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538200, rc 0) 00000100:00100000:3.0:1787790843.747397:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+22:12363:x1874634250211968:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 282us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.747405:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 194 00000100:00100000:3.0:1787790843.749847:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.750405:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250212096 00000100:00100000:0.0:1787790843.750416:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250212096 00000100:00100000:0.0:1787790843.750484:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:0.0:1787790843.750497:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+6:2402:x1874634250212096:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787790843.751036:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250212096:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 539us (1200us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787790843.751046:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:0.0:1787790843.753351:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.753473:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250212352 00000100:00100000:2.0:1787790843.753485:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250212352 00000100:00100000:2.0:1787790843.753565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:2.0:1787790843.753575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:12363:x1874634250212352:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787790843.754143:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+23:12363:x1874634250212352:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 567us (801us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787790843.754152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:2.0:1787790843.755752:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.755802:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250212608 00000100:00100000:3.0:1787790843.755822:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250212608 00000100:00100000:3.0:1787790843.755894:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 195 00000100:00100000:3.0:1787790843.755908:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:12363:x1874634250212608:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790843.756039:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:12363:x1874634250212608:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.756057:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 195 00000100:00100000:3.0:1787790843.762103:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.762197:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250212736 00000100:00100000:0.0:1787790843.762213:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250212736 00000100:00100000:0.0:1787790843.762412:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 196 00000100:00100000:0.0:1787790843.762433:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+23:12363:x1874634250212736:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790843.762454:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790843.762477:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e6f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e45 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.762601:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e6fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.762619:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.762633:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790843.762692:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790843.762751:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.762786:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e6f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e45 expref: 25 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.762809:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e6fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e45 expref: 24 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.762818:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:0.0:1787790843.762821:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787790843.762825:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5a00, rc 0) 00000100:00100000:0.0:1787790843.762935:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+24:12363:x1874634250212736:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 512us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.762943:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 196 00000100:00100000:3.0:1787790843.768105:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790843.768201:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250212864 00000100:00100000:1.0:1787790843.768217:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250212864 00000100:00100000:1.0:1787790843.768298:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:1.0:1787790843.768316:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250212864:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790843.768335:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790843.768361:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e4c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790843.768387:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85fc, blocks: 0x0 00010000:00010000:1.0:1787790843.768412:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787790843.768417:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790843.768431:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.768453:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.768489:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa000, rc 0) 00000100:00100000:1.0:1787790843.768575:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250212864:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 264us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790843.768588:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:2.0:1787790843.777245:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.778924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250213120 00000100:00100000:3.0:1787790843.778945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250213120 00000100:00100000:3.0:1787790843.779033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 197 00000100:00100000:3.0:1787790843.779047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+24:12363:x1874634250213120:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787790843.779233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+24:12363:x1874634250213120:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 188us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.779243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 197 00000100:00100000:1.0:1787790843.788284:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.790854:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250213248 00000100:00100000:0.0:1787790843.790878:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250213248 00000100:00100000:0.0:1787790843.790965:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:0.0:1787790843.790988:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:12363:x1874634250213248:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790843.791016:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790843.791043:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e53 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.791086:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.791097:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790843.791102:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790843.791108:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.791155:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.791183:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 9 pid: 8428 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.791202:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268092416:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790843.791474:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790843.799017:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.800958:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250213376 00000100:00100000:3.0:1787790843.800979:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250213376 00010000:00010000:3.0:1787790843.801035:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 10 pid: 8428 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.801137:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 89 00000100:00100000:3.0:1787790843.801150:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:2403:x1874634250213376:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790843.801182:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790843.801213:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 10 pid: 8428 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.801231:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 10 pid: 8428 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.801268:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790843.801296:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790843.801307:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.801450:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.801507:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.801526:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b15e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874634268092544:192.168.202.22@tcp:105: 00000100:00100000:3.0:1787790843.801762:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f87540 going to sleep for 11 seconds 00010000:00010000:0.0:1787790843.801901:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dae2a04a/0xcf9477fddcf1e701 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e4c expref: 10 pid: 8428 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.801918:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268092416:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790843.801969:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.801984:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5e00, rc 0) 00000100:00100000:0.0:1787790843.802883:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:12363:x1874634250213248:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 11891us (14604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.802895:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787790843.805553:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b15e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874634268092544:192.168.202.22@tcp:105: 00010000:00010000:3.0:1787790843.805591:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790843.805699:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250213376:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 4550us (6698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.805740:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 89 00000100:00100000:2.0:1787790843.807661:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790843.808026:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250213504 00000100:00100000:1.0:1787790843.808039:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250213504 00002000:00100000:1.0:1787790843.808108:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff916fc4596940 x1874634250213504/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:684/0 lens 504/0 e 0 to 0 dl 1787790854 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790843.808122:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc4596940 with x1874634250213504 ext(0->8) 00002000:00010000:1.0:1787790843.808129:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc4596940 00000100:00100000:1.0:1787790843.808160:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:1.0:1787790843.808182:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2401:x1874634250213504:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787790843.811832:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+10:2401:x1874634250213504:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 Request processed in 3633us (4169us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787790843.811851:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00002000:00100000:1.0:1787790843.811870:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff916fc4596940 x1874634250213504/t4294967315(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:684/0 lens 504/448 e 0 to 0 dl 1787790854 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790843.811882:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc4596940 with x1874634250213504 ext(0->8) 00002000:00010000:1.0:1787790843.811889:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc4596940 00000100:00100000:1.0:1787790843.816965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.817024:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250213632 00000100:00100000:3.0:1787790843.817037:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250213632 00000100:00100000:3.0:1787790843.817122:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 198 00000100:00100000:3.0:1787790843.817134:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+24:12363:x1874634250213632:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787790843.819327:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787790843.819356:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787790843.819406:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787790843.819428:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787790843.819443:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1787790843.819630:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.819646:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.819654:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.819662:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.819668:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.819677:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.819700:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:0.0:1787790843.819737:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787790843.819744:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.819750:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e6e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.819865:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790843.819888:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268092672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787790843.819983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790843.820058:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268092672 00000100:00100000:1.0:1787790843.820085:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268092672 00000100:00100000:1.0:1787790843.820156:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787790843.820177:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268092672:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1787790843.820189:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1787790843.820337:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790843.820341:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787790845 00002000:00010000:1.0:1787790843.820343:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787790843.820346:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787790844 -> 1787790845 00002000:00010000:1.0:1787790843.820348:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787790843.820401:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250213632:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 3260us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790843.820413:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 198 00000100:00100000:1.0:1787790843.820502:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268092672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 337us (519us total) trans 4294967316 rc 0/0 00000004:00080000:0.0:1787790843.822848:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170f67f5680/2, rc 0, transno 4294967316 00000100:00100000:0.0:1787790843.822868:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268092672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787790843.823410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.823492:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250213760 00000100:00100000:2.0:1787790843.823510:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250213760 00000100:00100000:2.0:1787790843.823567:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:2.0:1787790843.823577:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+10:2402:x1874634250213760:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787790843.824636:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000001:00080000:2.0:1787790843.825466:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787790843.825480:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1787790843.825676:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250213760:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 2094us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790843.825688:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:3.0:1787790843.828634:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.828701:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250214016 00000100:00100000:0.0:1787790843.828749:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250214016 00000100:00100000:3.0:1787790843.828874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 199 00000100:00100000:3.0:1787790843.828906:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250214016:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790843.828988:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790843.829022:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e6fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e45 expref: 19 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.829047:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:3.0:1787790843.829054:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790843.829095:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.829112:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.829125:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790843.829452:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3dc01cd reply state 0000000075837b39 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.829531:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.829540:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:3.0:1787790843.829543:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790843.829547:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790843.829698:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+20:12363:x1874634250214016:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 793us (1078us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1787790843.833055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.833241:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250214144 00000100:00100000:2.0:1787790843.833254:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250214144 00000100:00100000:2.0:1787790843.833323:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:2.0:1787790843.833335:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2400:x1874634250214144:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787790843.833539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 199 00002000:00010000:2.0:1787790843.833629:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787790843.833632:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787790845 -> 1787790843 00002000:00010000:2.0:1787790843.833634:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787790842 00002000:00010000:2.0:1787790843.833636:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787790845 -> 1787790843 00002000:00010000:2.0:1787790843.833638:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787790843.833800:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2400:x1874634250214144:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 466us (758us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787790843.833808:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:1.0:1787790843.837290:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.837392:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250214400 00000100:00100000:3.0:1787790843.837406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250214400 00000100:00100000:3.0:1787790843.837512:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 200 00000100:00100000:3.0:1787790843.837523:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+20:12363:x1874634250214400:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787790843.837617:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.837640:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.837650:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.837696:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.837756:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 20 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.837772:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268092800:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790843.837902:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed9153c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790843.840331:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268092800:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790843.840369:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790843.842375:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.842756:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250214528 00000100:00100000:0.0:1787790843.842770:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250214528 00010000:00010000:0.0:1787790843.842840:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 21 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.842905:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 90 00000100:00100000:0.0:1787790843.842918:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:2402:x1874634250214528:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790843.842938:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790843.842947:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 21 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.842963:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 21 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.842992:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e6de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e37 expref: 21 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.843028:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:0.0:1787790843.843034:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.843044:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.843053:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.843090:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790843.843177:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+20:2402:x1874634250214528:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 249us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.843186:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 90 00010000:00010000:3.0:1787790843.844971:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.844994:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845148:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845157:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845175:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845185:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790843.845191:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845200:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845219:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:3.0:1787790843.845223:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787790843.845229:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.845235:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e716 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.845527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250214400:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 Request processed in 8000us (8248us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787790843.845541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 200 00000100:00100000:3.0:1787790843.855308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.855654:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250214656 00000100:00100000:0.0:1787790843.855670:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250214656 00000100:00100000:0.0:1787790843.855769:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:0.0:1787790843.855782:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2401:x1874634250214656:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787790843.855929:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.856041:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.856053:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790843.856058:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790843.856064:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.856197:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.856214:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 8 pid: 8427 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.856233:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1874634268092928:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790843.856358:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790843.859973:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1874634268092928:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790843.860017:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.861632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.861777:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250214784 00000100:00100000:0.0:1787790843.861790:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250214784 00010000:00010000:0.0:1787790843.862056:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 9 pid: 8427 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.862276:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 91 00000100:00100000:0.0:1787790843.862290:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250214784:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790843.862314:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790843.862344:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 9 pid: 8427 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.862361:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 9 pid: 8427 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.862413:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020405ed7/0xcf9477fddcf1e708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e53 expref: 9 pid: 8427 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.862434:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790843.862440:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790843.862446:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.862459:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.862497:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790843.863694:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250214784:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 1397us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.863721:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 91 00010000:00010000:0.0:1787790843.863771:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.863785:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864620:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864635:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864650:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864658:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790843.864662:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864673:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864696:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.864735:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4399433/0xcf9477fddcf1e71d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.868611:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250214656:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 12809us (13312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790843.868632:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:0.0:1787790843.873282:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790843.873396:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250215040 00000100:00100000:3.0:1787790843.873430:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250215040 00000100:00100000:3.0:1787790843.873525:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 201 00000100:00100000:3.0:1787790843.873539:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+19:12363:x1874634250215040:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787790843.873657:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.873680:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.873691:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.873919:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.873952:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 19 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790843.874135:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268093056:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790843.874270:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed9153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790843.880926:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc2642580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268093056:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790843.881144:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790843.882053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.886621:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250215168 00000100:00100000:0.0:1787790843.886645:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250215168 00010000:00010000:0.0:1787790843.886733:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 20 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.887106:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 92 00000100:00100000:0.0:1787790843.887122:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+20:2403:x1874634250215168:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790843.887145:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790843.887154:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 20 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.887178:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 20 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.887208:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e56b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ddc expref: 20 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.887229:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790843.887235:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.887248:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.887258:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.887447:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790843.887532:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+19:2403:x1874634250215168:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 412us (5590us total) trans 0 rc 0/0 00010000:00010000:1.0:1787790843.887578:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.887587:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.888128:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.888145:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.888181:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.888226:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.888243:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790843.888259:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268093184:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790843.888426:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790843.892457:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 92 00000100:00100000:2.0:1787790843.896929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.897020:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268093184:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790843.897056:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790843.897292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250215296 00000100:00100000:2.0:1787790843.897301:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250215296 00010000:00010000:2.0:1787790843.897356:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790843.897397:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 93 00000100:00100000:2.0:1787790843.897409:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+20:2402:x1874634250215296:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790843.897446:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790843.897456:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.897485:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.897516:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1e6ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e3e expref: 20 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.897537:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:2.0:1787790843.897615:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.897627:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.897636:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.897679:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790843.897741:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.897756:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790843.897767:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:2402:x1874634250215296:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 360us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.897776:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 93 00000001:00080000:0.0:1787790843.898465:0:10093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787790843.901903:0:10093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1787790843.902047:0:10093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787790843.902189:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10093:1874634268093312:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790843.902287:0:10093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790843.902337:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790843.904665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268093312 00000100:00100000:2.0:1787790843.904685:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268093312 00000100:00100000:2.0:1787790843.904779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787790843.904793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10093:x1874634268093312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787790843.904972:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10093:x1874634268093312:12345-0@lo:1000:mdt00_003.0 Request processed in 182us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.904981:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787790843.905102:0:10093:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1787790843.905110:0:10093:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170f67f5680, transno 4294967316 00000100:00100000:0.0:1787790843.905141:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10093:1874634268093312:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787790843.905594:0:10093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1787790843.905678:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10093:1874634268093440:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790843.905872:0:10093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790843.907015:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fc226900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790843.911276:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268093440 00000100:00100000:2.0:1787790843.911298:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268093440 00000100:00100000:2.0:1787790843.911438:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787790843.911452:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10093:x1874634268093440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787790843.911973:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10093:x1874634268093440:12345-0@lo:1000:mdt00_003.0 Request processed in 522us (6099us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787790843.911983:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787790843.912246:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10093:1874634268093440:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787790843.912332:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912344:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912353:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912360:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790843.912366:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912376:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912409:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:1.0:1787790843.912413:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790843.912420:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912428:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e72b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912458:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912465:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912471:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912476:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790843.912480:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912485:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912493:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:1.0:1787790843.912496:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790843.912499:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912505:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1e660 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912545:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912564:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 22 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912575:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912621:0:10093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 22 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790843.912640:0:10093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 22 pid: 10093 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790843.912657:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268093568:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790843.912798:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790843.916648:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790843.916692:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250215424 00000100:00100000:2.0:1787790843.916722:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250215424 00010000:00010000:2.0:1787790843.916775:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 23 pid: 10093 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790843.916826:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 94 00000100:00100000:2.0:1787790843.916837:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:2402:x1874634250215424:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790843.916865:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790843.916874:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 23 pid: 10093 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.916890:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 23 pid: 10093 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.916924:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:2.0:1787790843.916929:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.916942:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.916951:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790843.916974:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790843.917037:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+23:2402:x1874634250215424:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 202us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790843.917045:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 94 00010000:00010000:0.0:1787790843.918049:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e67c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e22 expref: 22 pid: 10093 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.918072:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10093:1874634268093568:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790843.918099:0:10093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918110:0:10093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918116:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918140:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918148:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918157:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918173:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.918178:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918186:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918202:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790843.918205:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790843.918210:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918215:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e732 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918227:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918232:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918237:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918249:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790843.918252:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918258:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918267:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170fbd4af00) 00010000:00010000:0.0:1787790843.918269:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790843.918272:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.918277:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1e724 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790843.918531:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:12363:x1874634250215040:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 44992us (45275us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787790843.918542:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 201 00000020:00080000:0.0:1787790843.918549:0:10093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787790843.919390:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790843.919399:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790843.920739:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787790843.920758:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790843.928612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790843.928735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250215680 00000100:00100000:0.0:1787790843.928748:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250215680 00000100:00100000:0.0:1787790843.928824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:0.0:1787790843.928836:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+21:12363:x1874634250215680:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787790843.929213:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787790843.929259:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1787790843.929521:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.929543:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.929575:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.929585:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.929591:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.929597:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790843.929632:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787790843.929787:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:12363:x1874634250215680:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 950us (1188us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787790843.929796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000020:00080000:0.0:1787790843.929803:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787790843.931440:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790843.931458:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.931472:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790843.931477:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.931488:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.931531:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:3.0:1787790843.931535:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787790843.931542:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.931549:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e739 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790843.931575:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790843.931577:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790843.931579:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787790844.043326:0:14647:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787790844.043340:0:14647:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787790844.043368:0:14647:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787790844.043379:0:14647:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790844.188657:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790844.188891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250215936 00000100:00100000:3.0:1787790844.188915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250215936 00000100:00100000:3.0:1787790844.189021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 202 00000100:00100000:3.0:1787790844.189037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+23:12373:x1874634250215936:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790844.189081:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790844.189110:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538800/0xcf9477fddcf1e740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e5a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.189269:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1e747 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.189288:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1e747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.189305:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1e747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790844.189318:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787790844.189460:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538800/0xcf9477fddcf1e740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e5a expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.189505:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1e747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e5a expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.189516:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790844.189520:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790844.189524:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539e00, rc 0) 00000100:00100000:3.0:1787790844.189615:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+25:12373:x1874634250215936:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 582us (973us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787790844.189624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 202 00000100:00080000:0.0:1787790844.189963:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787790844.195236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790844.195450:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250216064 00000100:00100000:3.0:1787790844.195464:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250216064 00000100:00100000:3.0:1787790844.195546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 203 00000100:00100000:3.0:1787790844.195560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+25:12373:x1874634250216064:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:3.0:1787790844.195668:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195690:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195740:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195760:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195768:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195790:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195897:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195912:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790844.195983:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.195999:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.196006:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.196013:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.196020:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790844.196024:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.196032:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.196046:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790844.196055:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790844.196062:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199242:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539000/0xcf9477fddcf1e755 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199270:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199278:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199287:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199294:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790844.199300:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199310:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199332:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9170e58dde00) 00010000:00010000:3.0:1787790844.199336:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790844.199342:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199348:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539600/0xcf9477fddcf1e75c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199370:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199387:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199393:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199398:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790844.199402:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199409:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199418:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9170e58dd200) 00010000:00010000:3.0:1787790844.199420:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790844.199424:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.199430:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e763 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790844.199582:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+25:12373:x1874634250216064:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 4018us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790844.199596:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 203 00000100:00100000:1.0:1787790844.259518:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790844.259572:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250216320 00000100:00100000:1.0:1787790844.259586:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250216320 00000100:00100000:1.0:1787790844.259669:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 204 00000100:00100000:1.0:1787790844.259682:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+25:12376:x1874634250216320:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790844.259739:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790844.259770:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e76a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e61 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.259964:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260001:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260017:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260036:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260044:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260052:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260214:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260224:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.260231:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790844.260242:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787790844.261498:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261515:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261524:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261543:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fae00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790844.261548:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261557:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261575:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790844.261579:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790844.261586:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261594:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e771 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261608:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261614:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261619:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261624:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790844.261627:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261633:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261650:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:1.0:1787790844.261653:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790844.261656:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261661:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e778 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261743:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e76a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 28 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261760:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 27 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.261769:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:1.0:1787790844.261771:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790844.261774:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbe00, rc 0) 00000100:00100000:1.0:1787790844.261897:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+27:12376:x1874634250216320:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 2217us (2396us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787790844.261907:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 204 00000100:00100000:0.0:1787790844.272666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790844.272787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250216448 00000100:00100000:3.0:1787790844.272798:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250216448 00000100:00100000:3.0:1787790844.272869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 205 00000100:00100000:3.0:1787790844.272880:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:12376:x1874634250216448:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787790844.272969:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.272999:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273013:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273060:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273077:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273085:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273092:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790844.273097:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273105:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:3.0:1787790844.273122:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790844.273127:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.273133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e78d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790844.273227:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:12376:x1874634250216448:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 348us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790844.273240:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 205 00000100:00100000:1.0:1787790844.275991:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.276121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250216704 00000100:00100000:0.0:1787790844.276136:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250216704 00000100:00100000:0.0:1787790844.276223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787790844.276235:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+27:12376:x1874634250216704:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790844.276583:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+28:12376:x1874634250216704:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 349us (607us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787790844.276593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:1.0:1787790844.319626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.323424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250216960 00000100:00100000:0.0:1787790844.323449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250216960 00000100:00100000:0.0:1787790844.323545:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 206 00000100:00100000:0.0:1787790844.323559:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+28:11908:x1874634250216960:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790844.323595:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790844.323624:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e794 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e68 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.324045:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.324066:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 29 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.324089:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.324143:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 29 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.324171:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 29 pid: 10093 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790844.324189:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268093696:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790844.324970:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e5d040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790844.338338:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.338390:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217088 00000100:00100000:2.0:1787790844.338401:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217088 00010000:00010000:2.0:1787790844.338470:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 30 pid: 10093 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790844.338521:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 95 00000100:00100000:2.0:1787790844.338534:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+30:2403:x1874634250217088:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790844.338554:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790844.338563:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 30 pid: 10093 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.338579:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 30 pid: 10093 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.338612:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:2.0:1787790844.338620:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.338632:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.338643:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.338666:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790844.338762:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+30:2403:x1874634250217088:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790844.338770:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 95 00010000:00010000:0.0:1787790844.340051:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e77f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e61 expref: 29 pid: 10093 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790844.340433:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268093696:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790844.340465:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.340476:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.340483:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790844.340510:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787790844.340687:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e794 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.340747:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.340757:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:0.0:1787790844.340761:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790844.340765:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5a00, rc 0) 00000100:00100000:0.0:1787790844.342226:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+29:11908:x1874634250216960:12345-192.168.202.22@tcp:101:bash.0 Request processed in 18660us (22605us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787790844.342241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 206 00000100:00100000:0.0:1787790844.360635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.360699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217216 00000100:00100000:0.0:1787790844.360729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217216 00000100:00100000:0.0:1787790844.360796:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 207 00000100:00100000:0.0:1787790844.360806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+29:11908:x1874634250217216:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790844.360836:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790844.360862:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e6f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.360911:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e7b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.360931:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.360945:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.363454:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e6f expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.363492:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e6f expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.363503:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:0.0:1787790844.363507:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790844.363512:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5600, rc 0) 00000100:00100000:0.0:1787790844.363614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+30:11908:x1874634250217216:12345-192.168.202.22@tcp:101:bash.0 Request processed in 2807us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790844.363624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 207 00000100:00100000:2.0:1787790844.369219:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.369364:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217472 00000100:00100000:0.0:1787790844.369378:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217472 00000100:00100000:0.0:1787790844.369463:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 208 00000100:00100000:0.0:1787790844.369476:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+30:11908:x1874634250217472:12345-192.168.202.22@tcp:36:bash.0 00010000:00010000:0.0:1787790844.369806:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.369830:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.369845:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790844.369898:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1787790844.369925:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2efc22d reply state 0000000089ddefb1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.369942:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.369950:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:0.0:1787790844.369953:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790844.369957:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787790844.370001:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1787790844.371256:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+34:11908:x1874634250217472:12345-192.168.202.22@tcp:36:bash.0 Request processed in 1775us (2045us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787790844.371270:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 208 00000020:00080000:0.0:1787790844.371279:0:10094:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787790844.381856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.385235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217600 00000100:00100000:2.0:1787790844.385255:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217600 00000100:00100000:2.0:1787790844.385427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 209 00000100:00100000:2.0:1787790844.385439:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+34:11908:x1874634250217600:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790844.385473:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790844.385504:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e7be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.385588:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e7be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e76 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.385605:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e7be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e76 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.385629:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:2.0:1787790844.385632:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790844.385637:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994600, rc 0) 00000100:00100000:2.0:1787790844.385917:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+35:11908:x1874634250217600:12345-192.168.202.22@tcp:101:bash.0 Request processed in 479us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790844.385926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 209 00000100:00100000:0.0:1787790844.394607:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.394761:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217728 00000100:00100000:2.0:1787790844.394776:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217728 00000100:00100000:2.0:1787790844.394864:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:2.0:1787790844.394877:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:11908:x1874634250217728:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790844.394901:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790844.394930:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e7d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790844.395107:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f85fb, atime: 0x6a8f85fa, ctime: 0x6a8f85fb, blocks: 0x8 00010000:00010000:2.0:1787790844.395152:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787790844.395166:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790844.395178:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.395202:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.395220:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994e00, rc 0) 00000100:00100000:2.0:1787790844.395306:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:11908:x1874634250217728:12345-192.168.202.22@tcp:101:bash.0 Request processed in 431us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790844.395314:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00080000:0.0:1787790844.395472:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790844.405768:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790844.405875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217856 00000100:00100000:3.0:1787790844.405887:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217856 00002000:00010000:3.0:1787790844.405944:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1787790844.405951:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc45b03c0 with x1874634250217856 ext(0->18446744073709551615) 00002000:00010000:3.0:1787790844.405966:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc45b03c0. 00000100:00100000:3.0:1787790844.405997:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787790844.406008:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:2401:x1874634250217856:12345-192.168.202.22@tcp:10:bash.0 00002000:00010000:3.0:1787790844.406360:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787790844.406363:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787790843 -> 1787790845 00002000:00010000:3.0:1787790844.406366:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787790842 -> 1787790842 00002000:00010000:3.0:1787790844.406367:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787790843 -> 1787790845 00002000:00010000:3.0:1787790844.406369:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787790844.406444:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:2401:x1874634250217856:12345-192.168.202.22@tcp:10:bash.0 Request processed in 439us (693us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787790844.406451:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00002000:00010000:3.0:1787790844.406454:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1787790844.406456:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc45b03c0 with x1874634250217856 ext(0->18446744073709551615) 00002000:00010000:3.0:1787790844.406459:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc45b03c0. 00000100:00100000:3.0:1787790844.476841:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.477147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250217984 00000100:00100000:0.0:1787790844.477183:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250217984 00000100:00100000:0.0:1787790844.477252:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 210 00000100:00100000:0.0:1787790844.477369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+35:12390:x1874634250217984:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:0.0:1787790844.477449:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477467:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477479:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477493:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477500:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477506:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477602:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477611:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477617:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790844.477663:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477687:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477694:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477702:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477764:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790844.477769:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477777:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477791:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790844.477794:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790844.477809:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477816:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477834:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477840:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477846:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477866:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790844.477870:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477875:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477883:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9170e15d8000) 00010000:00010000:0.0:1787790844.477885:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790844.477888:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477893:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477908:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477915:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477920:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477925:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790844.477928:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477934:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477951:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:0.0:1787790844.477953:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790844.477957:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.477962:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790844.478041:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc2642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+35:12390:x1874634250217984:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 777us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790844.478050:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 210 00000100:00100000:2.0:1787790844.521386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.523066:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250218240 00000100:00100000:0.0:1787790844.523083:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250218240 00000100:00100000:0.0:1787790844.523167:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 211 00000100:00100000:0.0:1787790844.523180:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+35:12393:x1874634250218240:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790844.523202:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790844.523224:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e84 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523311:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523326:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523337:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523352:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523375:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523382:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523493:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e7f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523503:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523510:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790844.523532:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787790844.523614:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523621:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523629:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523636:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790844.523640:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523648:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523671:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790844.523674:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790844.523680:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523687:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e7e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523765:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523771:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523777:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523782:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790844.523785:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523791:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523868:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9170e15d8000) 00010000:00010000:0.0:1787790844.523871:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790844.523876:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523882:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e7ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523935:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e7e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e84 expref: 38 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523947:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e84 expref: 37 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.523954:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:0.0:1787790844.523956:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787790844.523959:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5800, rc 0) 00000100:00100000:0.0:1787790844.524025:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+37:12393:x1874634250218240:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 849us (2652us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787790844.524032:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 211 00000100:00100000:1.0:1787790844.530417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.530662:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250218368 00000100:00100000:2.0:1787790844.530672:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250218368 00000100:00100000:2.0:1787790844.530921:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 212 00000100:00100000:2.0:1787790844.530932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+37:12393:x1874634250218368:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:2.0:1787790844.531008:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.531025:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.531035:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.531074:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.531104:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 37 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790844.531119:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268093824:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790844.531237:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790844.533683:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1fb5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268093824:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790844.533742:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790844.539087:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.539630:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250218624 00000100:00100000:0.0:1787790844.539641:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250218624 00000100:00100000:0.0:1787790844.539702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:0.0:1787790844.539734:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:6167:x1874634250218624:12345-192.168.202.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787790844.540031:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+39:6167:x1874634250218624:12345-192.168.202.22@tcp:35:ldlm_bl.0 Request processed in 300us (955us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787790844.540040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:3.0:1787790844.542999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.543582:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250218752 00000100:00100000:2.0:1787790844.543594:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250218752 00010000:00010000:2.0:1787790844.543640:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 39 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790844.543684:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:2.0:1787790844.543693:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+39:2403:x1874634250218752:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790844.543745:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790844.543752:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 39 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.543762:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 39 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.543782:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e79b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e68 expref: 39 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.543798:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:2.0:1787790844.543802:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.543831:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.543838:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.543863:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790844.544043:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544052:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544093:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544101:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544108:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544114:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790844.544119:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544127:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544138:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:1.0:1787790844.544140:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790844.544144:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.544148:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1e804 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790844.544470:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+38:2403:x1874634250218752:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 775us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790844.544470:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+38:12393:x1874634250218368:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 13539us (14162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790844.544481:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:1.0:1787790844.544481:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 212 00000100:00100000:3.0:1787790844.547363:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.547484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250219008 00000100:00100000:0.0:1787790844.547493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250219008 00000100:00100000:0.0:1787790844.547585:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:0.0:1787790844.547595:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+37:12393:x1874634250219008:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790844.547856:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+38:12393:x1874634250219008:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 254us (493us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787790844.547881:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:3.0:1787790844.681658:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.682265:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250219264 00000100:00100000:2.0:1787790844.682347:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250219264 00000100:00100000:2.0:1787790844.682416:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 213 00000100:00100000:2.0:1787790844.682428:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+38:12404:x1874634250219264:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:2.0:1787790844.682453:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790844.682475:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e80b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e8b expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682551:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682566:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682578:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682590:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682677:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682684:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682827:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e820 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682838:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.682845:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790844.683103:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787790844.683347:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683356:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683364:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683371:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790844.683375:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683383:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683409:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790844.683412:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790844.683417:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683423:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e812 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683438:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683444:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683450:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683456:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790844.683459:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683465:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683473:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3701800) 00010000:00010000:2.0:1787790844.683475:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790844.683479:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683485:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e819 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683539:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1e80b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e8b expref: 41 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683554:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e8b expref: 40 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.683562:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:2.0:1787790844.683565:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790844.683567:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994c00, rc 0) 00000100:00100000:2.0:1787790844.683840:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+40:12404:x1874634250219264:12345-192.168.202.22@tcp:101:cat.0 Request processed in 1413us (2193us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787790844.683862:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 213 00000100:00100000:3.0:1787790844.693194:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790844.693982:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250219520 00000100:00100000:1.0:1787790844.693993:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250219520 00000100:00100000:1.0:1787790844.694170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:1.0:1787790844.694182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+40:12404:x1874634250219520:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:1.0:1787790844.694538:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+41:12404:x1874634250219520:12345-192.168.202.22@tcp:35:cat.0 Request processed in 357us (1489us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787790844.694551:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:3.0:1787790844.714669:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790844.716376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250219776 00000100:00100000:1.0:1787790844.716390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250219776 00000100:00100000:1.0:1787790844.716460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 214 00000100:00100000:1.0:1787790844.716470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+41:12405:x1874634250219776:12345-192.168.202.22@tcp:36:rm.0 00010000:00010000:1.0:1787790844.716541:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787790844.716570:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1e7be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e76 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.716592:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e820 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e8b expref: 40 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.716816:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e7f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e84 expref: 39 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.716830:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e7b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e6f expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717043:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:1.0:1787790844.717108:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790844.717133:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717148:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717168:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717184:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717191:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717197:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717277:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717284:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717291:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790844.717686:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:1.0:1787790844.717766:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717784:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.717792:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718022:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718030:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718036:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718285:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790844.718405:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790844.718413:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.718420:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fae00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790844.718424:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.718431:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.718442:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:3.0:1787790844.718445:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787790844.718449:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.718454:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1e843 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790844.718467:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790844.718469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790844.718470:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790844.718512:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718528:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718534:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718539:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790844.718544:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718550:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718576:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:1.0:1787790844.718578:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787790844.718582:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718587:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e83c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718757:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718765:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718771:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718776:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fba00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790844.718780:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718785:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718793:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790844.718806:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790844.718813:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.718819:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e82e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790844.718839:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000589ac464 reply state 00000000fcf1de98 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.719093:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.719101:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:1.0:1787790844.719103:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790844.719107:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790844.719210:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+39:12405:x1874634250219776:12345-192.168.202.22@tcp:36:rm.0 Request processed in 2738us (4547us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787790844.719219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 214 00000100:00100000:3.0:1787790844.746934:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790844.746961:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268093952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790844.747039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790844.747055:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790844.747109:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268093952 00000100:00100000:0.0:1787790844.747117:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268093952 00000100:00100000:0.0:1787790844.747179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787790844.747189:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268093952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790844.747233:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787790844.747272:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268094080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790844.747300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268093952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790844.747308:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787790844.747310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790844.747323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268094080 00000100:00100000:0.0:1787790844.747326:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268094080 00000100:00100000:0.0:1787790844.747341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787790844.747347:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268094080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790844.747364:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790844.747404:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268094080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790844.747410:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787790844.747454:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268093952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790844.747529:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268094080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790844.815402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790844.815696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250220032 00000100:00100000:1.0:1787790844.815765:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250220032 00000100:00100000:1.0:1787790844.815833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 215 00000100:00100000:1.0:1787790844.815843:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+39:12411:x1874634250220032:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787790844.815869:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790844.815892:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e84a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e92 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816001:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816017:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816029:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816210:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816220:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816227:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790844.816805:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787790844.816952:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816963:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.816971:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817002:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817008:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817015:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817021:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790844.817025:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817044:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817126:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790844.817130:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790844.817135:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817142:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e851 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790844.817165:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e82783b reply state 000000008b994f8d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817175:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817181:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:1.0:1787790844.817183:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787790844.817187:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787790844.817221:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e84a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817237:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790844.817244:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:1.0:1787790844.817246:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790844.817248:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbe00, rc 0) 00000100:00100000:1.0:1787790844.817396:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1fb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+42:12411:x1874634250220032:12345-192.168.202.22@tcp:101:bash.0 Request processed in 1553us (2003us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787790844.817411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 215 00000100:00100000:3.0:1787790844.829831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.830079:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250220160 00000100:00100000:2.0:1787790844.830090:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250220160 00000100:00100000:2.0:1787790844.830187:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:2.0:1787790844.830199:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2400:x1874634250220160:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790844.830218:0:10092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790844.830238:0:10092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223e99 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790844.830264:0:10092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790844.830286:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787790844.830291:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790844.830300:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 8 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.830347:0:10092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 8 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.830363:0:10092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790844.830424:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:2400:x1874634250220160:12345-192.168.202.22@tcp:101:bash.0 Request processed in 228us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790844.830431:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00080000:0.0:1787790844.831027:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790844.839384:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790844.839506:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250220288 00000100:00100000:2.0:1787790844.839524:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250220288 00000100:00100000:2.0:1787790844.839577:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:2.0:1787790844.839586:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+8:12411:x1874634250220288:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790844.839701:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790844.839743:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ea0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.839775:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 9 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.839785:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790844.839790:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790844.839795:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.839838:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 9 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.839861:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 9 pid: 10092 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790844.839876:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1874634268094208:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790844.840007:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790844.854008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.854911:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250220416 00000100:00100000:0.0:1787790844.854922:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250220416 00010000:00010000:0.0:1787790844.854974:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 10 pid: 10092 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790844.855031:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 97 00000100:00100000:0.0:1787790844.855042:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+10:2402:x1874634250220416:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790844.855069:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790844.855107:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 10 pid: 10092 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.855122:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 10 pid: 10092 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.855150:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790844.855165:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790844.855175:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.855187:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790844.855232:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790844.855247:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874634268094336:192.168.202.22@tcp:105: 00000100:00100000:0.0:1787790844.855348:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c3236600 going to sleep for 11 seconds 00010000:00010000:2.0:1787790844.857576:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e86d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e99 expref: 10 pid: 10092 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790844.857611:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1874634268094208:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790844.857645:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790844.857661:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995200, rc 0) 00000100:00100000:2.0:1787790844.857751:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+9:12411:x1874634250220288:12345-192.168.202.22@tcp:101:bash.0 Request processed in 18166us (18377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790844.857761:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:0.0:1787790844.863128:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874634268094336:192.168.202.22@tcp:105: 00010000:00010000:0.0:1787790844.863171:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790844.863263:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250220416:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 8222us (9267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790844.863274:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 97 00000100:00100000:3.0:1787790844.865888:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790844.866042:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250220672 00000100:00100000:0.0:1787790844.866063:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250220672 00000100:00100000:0.0:1787790844.866135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:0.0:1787790844.866145:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+42:12411:x1874634250220672:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:0.0:1787790844.866457:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+43:12411:x1874634250220672:12345-192.168.202.22@tcp:35:bash.0 Request processed in 312us (577us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787790844.866465:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:3.0:1787790845.039443:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.039647:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250220800 00000100:00100000:2.0:1787790845.039657:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250220800 00000100:00100000:2.0:1787790845.039760:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 216 00000100:00100000:2.0:1787790845.039771:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+43:12427:x1874634250220800:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790845.039797:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790845.039821:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e87b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ea7 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.039915:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e882 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.039929:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.039941:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790845.039983:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787790845.039988:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790845.040007:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.040033:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e87b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea7 expref: 45 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.040053:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e882 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea7 expref: 44 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.040061:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790845.040064:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790845.040067:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994a00, rc 0) 00000100:00100000:2.0:1787790845.040129:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+44:12427:x1874634250220800:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 361us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.040137:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 216 00000100:00100000:3.0:1787790845.053770:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.053973:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250221056 00000100:00100000:1.0:1787790845.053985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250221056 00000100:00100000:1.0:1787790845.054055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 217 00000100:00100000:1.0:1787790845.054065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+44:12427:x1874634250221056:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790845.054086:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790845.054108:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e889 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223eae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.054250:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e890 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.054265:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.054401:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790845.054415:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787790845.055413:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e889 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eae expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.055442:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eae expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.055452:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:1.0:1787790845.055456:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790845.055460:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb600, rc 0) 00000100:00100000:1.0:1787790845.055637:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+46:12427:x1874634250221056:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1571us (1876us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787790845.055646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 217 00000100:00100000:3.0:1787790845.059265:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790845.059333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.059537:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250221184 00000100:00100000:0.0:1787790845.059548:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250221184 00000100:00100000:0.0:1787790845.059618:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:0.0:1787790845.059628:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+46:2402:x1874634250221184:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790845.059646:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790845.059672:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb600/0xcf9477fddcf1e890 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eae expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.059691:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:0.0:1787790845.059697:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790845.059789:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+45:2402:x1874634250221184:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 162us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.059796:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:1.0:1787790845.059998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250221440 00000100:00100000:1.0:1787790845.060004:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250221440 00000100:00100000:1.0:1787790845.060046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 218 00000100:00100000:1.0:1787790845.060055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+45:12427:x1874634250221440:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790845.060077:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790845.060094:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e89e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223eb5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.060206:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e8a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.060221:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.060232:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790845.060244:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787790845.060542:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1e89e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eb5 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.060558:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eb5 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.060565:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:1.0:1787790845.060568:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787790845.060585:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26faa00, rc 0) 00000100:00100000:1.0:1787790845.060618:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+47:12427:x1874634250221440:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 564us (1284us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1787790845.060626:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 218 00000100:00100000:3.0:1787790845.072033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.072189:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250221568 00000100:00100000:2.0:1787790845.072200:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250221568 00000100:00100000:2.0:1787790845.072278:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:2.0:1787790845.072288:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250221568:12345-192.168.202.22@tcp:1:lfs.0 00010000:00010000:2.0:1787790845.072424:0:10092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.072445:0:10092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.072454:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787790845.072459:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790845.072463:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.072500:0:10092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.072514:0:10092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 8 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790845.073616:0:10092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10092:1874634268094464:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790845.073737:0:10092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790845.077139:0:10092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc39f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10092:1874634268094464:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790845.077184:0:10092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790845.079417:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.079975:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250221696 00000100:00100000:1.0:1787790845.079986:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250221696 00002000:00100000:1.0:1787790845.080040:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff916fc4546d00 x1874634250221696/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:686/0 lens 504/0 e 0 to 0 dl 1787790856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790845.080051:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc4546d00 with x1874634250221696 ext(0->8) 00010000:00010000:1.0:1787790845.080061:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.080079:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790845.080086:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc4546d00 00000100:00100000:1.0:1787790845.080163:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:1.0:1787790845.080173:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250221696:12345-192.168.202.22@tcp:4:lfs.0 00000100:00100000:1.0:1787790845.081877:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+11:2402:x1874634250221696:12345-192.168.202.22@tcp:4:lfs.0 Request processed in 1688us (2452us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787790845.081894:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00002000:00100000:1.0:1787790845.081912:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff916fc4546d00 x1874634250221696/t4294967309(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:686/0 lens 504/448 e 0 to 0 dl 1787790856 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787790845.081924:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc4546d00 with x1874634250221696 ext(0->8) 00010000:00010000:1.0:1787790845.081938:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.081978:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790845.081986:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff916fc4546d00 00000100:00100000:3.0:1787790845.090019:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.090144:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250221824 00000100:00100000:1.0:1787790845.090180:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250221824 00010000:00010000:1.0:1787790845.090253:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790845.090378:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 98 00000100:00100000:1.0:1787790845.090390:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+11:2402:x1874634250221824:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790845.090413:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787790845.090442:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787790845.090445:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787790846 00002000:00010000:1.0:1787790845.090447:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787790846 00002000:00010000:1.0:1787790845.090449:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787790846 00002000:00010000:1.0:1787790845.090453:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787790845.090473:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.090490:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.090527:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1e874 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea0 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.090577:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790845.090581:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790845.090940:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.090956:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.091011:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790845.091091:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:2402:x1874634250221824:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 701us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.091101:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 98 00010000:00010000:3.0:1787790845.091621:0:10092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091643:0:10092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091681:0:10092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091692:0:10092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091743:0:10092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091754:0:10092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790845.091760:0:10092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091803:0:10092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091826:0:10092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.091835:0:10092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1e8b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790845.091941:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+9:2403:x1874634250221568:12345-192.168.202.22@tcp:1:lfs.0 Request processed in 19651us (19923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790845.091950:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:3.0:1787790845.102849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.105729:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250222080 00000100:00100000:0.0:1787790845.105753:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250222080 00000100:00100000:0.0:1787790845.106228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:0.0:1787790845.106243:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+47:12427:x1874634250222080:12345-192.168.202.22@tcp:35:lfs.0 00000004:00010000:0.0:1787790845.106344:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eb5 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790845.106853:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787790845.106916:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787790845.108699:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1787790845.108831:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.108857:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.108870:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.108924:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.108947:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 51 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.108966:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874634268094592:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790845.109107:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c3236180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790845.133085:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.133237:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250222208 00000100:00100000:2.0:1787790845.133269:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250222208 00010000:00010000:2.0:1787790845.133335:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 52 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790845.133404:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 99 00000100:00100000:2.0:1787790845.133415:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+52:2402:x1874634250222208:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790845.133436:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790845.133444:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 52 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.133470:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 52 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.133499:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:2.0:1787790845.133505:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.133517:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.133526:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.133548:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790845.133619:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+52:2402:x1874634250222208:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 205us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.133627:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 99 00010000:00010000:0.0:1787790845.135352:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e85f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e92 expref: 51 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.135382:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874634268094592:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790845.135423:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.135435:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.135442:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790845.135610:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1787790845.135851:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787790845.135986:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268094720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787790845.136075:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790845.136112:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790845.136285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268094720 00000100:00100000:1.0:1787790845.136293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268094720 00000100:00100000:1.0:1787790845.136381:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787790845.136393:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1874634268094720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787790845.136501:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1874634268094720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.136509:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1787790845.136926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790845.136966:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268094720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787790845.137273:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1787790845.137356:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268094848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787790845.137654:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790845.137692:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c3236600 going to sleep for 11 seconds 00000100:00100000:3.0:1787790845.137859:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268094848 00000100:00100000:3.0:1787790845.137866:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268094848 00000100:00100000:3.0:1787790845.137918:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787790845.137927:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1874634268094848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787790845.138101:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6515:x1874634268094848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 175us (447us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787790845.138109:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787790845.138374:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874634268094848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787790845.138584:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1787790845.138635:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.138646:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.138653:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.138660:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.138665:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.138674:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.141316:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:0.0:1787790845.141329:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787790845.141340:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.141351:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790845.143168:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787790845.143283:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787790845.143468:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394091761932ns, next at 395091589487ns, rc = 0 00000001:00080000:0.0:1787790845.143484:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1787790845.143565:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff916fc2690600) 00010000:00010000:0.0:1787790845.143570:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787790845.143587:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e8a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eb5 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.143815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+54:12427:x1874634250222080:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 37575us (40983us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787790845.143827:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00000020:00080000:0.0:1787790845.143834:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787790845.149232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.149344:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250222336 00000100:00100000:0.0:1787790845.149358:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250222336 00000100:00100000:0.0:1787790845.149472:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 219 00000100:00100000:0.0:1787790845.149486:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+54:12427:x1874634250222336:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790845.149517:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790845.149549:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e8c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.149797:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ebc expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.149816:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ebc expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.149838:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.149842:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790845.149846:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4000, rc 0) 00000100:00100000:0.0:1787790845.149917:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+55:12427:x1874634250222336:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 434us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.149926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 219 00000100:00100000:3.0:1787790845.156087:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.156231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250222592 00000100:00100000:1.0:1787790845.156245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250222592 00000100:00100000:1.0:1787790845.156468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:1.0:1787790845.156483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+55:12427:x1874634250222592:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:1.0:1787790845.156922:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+56:12427:x1874634250222592:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 440us (848us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787790845.156932:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:1.0:1787790845.297844:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.297954:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250222720 00000100:00100000:0.0:1787790845.297965:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250222720 00000100:00100000:0.0:1787790845.298028:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 220 00000100:00100000:0.0:1787790845.298038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+56:12437:x1874634250222720:12345-192.168.202.22@tcp:34:lfs.0 00010000:00010000:0.0:1787790845.298118:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298137:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298161:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298174:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298200:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298208:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298287:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298307:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298315:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790845.298365:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298378:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298384:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298391:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298397:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.298401:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298408:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298430:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790845.298433:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.298438:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298444:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298460:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298466:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298471:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298476:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.298478:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298483:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298490:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:0.0:1787790845.298492:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.298494:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298499:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298519:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298525:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298529:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298534:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.298536:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298541:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298548:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.298551:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.298553:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.298559:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.298637:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+56:12437:x1874634250222720:12345-192.168.202.22@tcp:34:lfs.0 Request processed in 599us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.298646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 220 00000100:00100000:3.0:1787790845.346215:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.346328:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250222976 00000100:00100000:0.0:1787790845.346338:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250222976 00000100:00100000:0.0:1787790845.346402:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 221 00000100:00100000:0.0:1787790845.346429:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+56:12440:x1874634250222976:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790845.346451:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790845.346472:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ec3 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346546:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346560:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346572:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346582:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346589:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346596:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346748:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e8f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346756:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346764:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790845.346784:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787790845.346875:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346883:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346889:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346895:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.346899:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346908:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346920:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790845.346924:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.346928:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346934:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e8e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346949:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346956:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346971:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346976:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.346978:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346984:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.346991:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:0.0:1787790845.346993:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.346997:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.347002:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e8eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.347032:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e8dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ec3 expref: 59 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.347045:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ec3 expref: 58 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.347052:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.347054:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790845.347057:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4600, rc 0) 00000100:00100000:0.0:1787790845.347121:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+58:12440:x1874634250222976:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 694us (915us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787790845.347137:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 221 00000100:00100000:3.0:1787790845.351796:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.351903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250223104 00000100:00100000:0.0:1787790845.351914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250223104 00000100:00100000:0.0:1787790845.351968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 222 00000100:00100000:0.0:1787790845.351978:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+58:12440:x1874634250223104:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:0.0:1787790845.352048:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352065:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352076:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352108:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352114:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352121:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352127:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.352131:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352138:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352148:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.352176:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790845.352181:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.352188:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e900 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.352406:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+58:12440:x1874634250223104:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 428us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.352414:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 222 00000100:00100000:3.0:1787790845.355878:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.355979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250223360 00000100:00100000:0.0:1787790845.355988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250223360 00000100:00100000:0.0:1787790845.356047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:0.0:1787790845.356058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+58:12440:x1874634250223360:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790845.356423:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+59:12440:x1874634250223360:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 366us (553us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787790845.356432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:3.0:1787790845.481442:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.481737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250223616 00000100:00100000:1.0:1787790845.481746:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250223616 00000100:00100000:1.0:1787790845.481812:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 223 00000100:00100000:1.0:1787790845.481823:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+59:12450:x1874634250223616:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787790845.481849:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790845.481853:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787790845.481881:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e882 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ea7 expref: 59 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.481903:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:1.0:1787790845.481908:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790845.481923:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e907 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223eca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.482035:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.482049:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.482060:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790845.482069:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787790845.482224:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e907 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.482239:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.482246:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:1.0:1787790845.482249:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790845.482252:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa000, rc 0) 00000100:00100000:1.0:1787790845.482319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+60:12450:x1874634250223616:12345-192.168.202.22@tcp:101:bash.0 Request processed in 497us (887us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787790845.482328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 223 00000100:00100000:3.0:1787790845.487882:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790845.487925:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.488052:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250223872 00000100:00100000:1.0:1787790845.488062:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250223872 00000100:00100000:1.0:1787790845.488127:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 224 00000100:00100000:1.0:1787790845.488137:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+60:12450:x1874634250223872:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787790845.488175:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790845.488209:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e91c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ed1 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.488250:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.488264:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.488275:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.488405:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e91c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 62 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.488423:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 61 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.488431:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:1.0:1787790845.488434:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790845.488437:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb000, rc 0) 00000100:00100000:1.0:1787790845.488499:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+61:12450:x1874634250223872:12345-192.168.202.22@tcp:101:bash.0 Request processed in 363us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.488506:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 224 00000100:00100000:1.0:1787790845.494884:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790845.494994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250224128 00000100:00100000:3.0:1787790845.495005:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250224128 00000100:00100000:3.0:1787790845.495066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 225 00000100:00100000:3.0:1787790845.495077:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+61:12450:x1874634250224128:12345-192.168.202.22@tcp:36:bash.0 00010000:00010000:3.0:1787790845.495129:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790845.495171:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1e8f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ec3 expref: 61 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.495202:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:3.0:1787790845.495208:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790845.495397:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.495412:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.495420:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.495452:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.495466:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 61 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790845.495480:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268094976:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790845.495589:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787790845.496919:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250223744 00000100:00100000:0.0:1787790845.496931:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250223744 00010000:00010000:0.0:1787790845.496970:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 62 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.497012:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 100 00000100:00100000:0.0:1787790845.497022:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+62:2402:x1874634250223744:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790845.497035:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790845.497042:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 62 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.497071:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 62 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.497094:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.497098:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.497106:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.497113:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.497131:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790845.497202:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+62:2402:x1874634250223744:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 181us (9275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.497210:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 100 00010000:00010000:3.0:1787790845.500442:0:6512:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.22@tcp) returned -22 from blocking AST (req@000000001d3d4bc5 x1874634268094976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 61 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.500467:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa000/0xcf9477fddcf1e90e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eca expref: 61 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790845.500483:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874634268094976:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790845.500506:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:3.0:1787790845.500514:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.500523:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.500529:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787790845.500621:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1787790845.500669:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0e5f926 reply state 000000000709c2e4 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.500686:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790845.500695:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:3.0:1787790845.500697:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790845.500700:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787790845.500860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+62:12450:x1874634250224128:12345-192.168.202.22@tcp:36:bash.0 Request processed in 5783us (5985us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787790845.500885:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 225 00000020:00080000:3.0:1787790845.500891:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787790845.505920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.506030:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250224256 00000100:00100000:0.0:1787790845.506040:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250224256 00000100:00100000:0.0:1787790845.506101:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 226 00000100:00100000:0.0:1787790845.506112:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+62:12450:x1874634250224256:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790845.506136:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790845.506170:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e931 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ed8 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.506310:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.506339:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.506353:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790845.506385:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787790845.506390:0:10093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790845.506408:0:10093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.506434:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e931 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 64 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.506455:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 63 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.506464:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.506467:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790845.506470:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4200, rc 0) 00000100:00100000:0.0:1787790845.506542:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+63:12450:x1874634250224256:12345-192.168.202.22@tcp:101:bash.0 Request processed in 432us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.506550:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 226 00000100:00100000:2.0:1787790845.516904:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.517008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250224512 00000100:00100000:1.0:1787790845.517019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250224512 00000100:00100000:1.0:1787790845.517083:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:1.0:1787790845.517095:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+63:12450:x1874634250224512:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:1.0:1787790845.517353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc39f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+64:12450:x1874634250224512:12345-192.168.202.22@tcp:35:bash.0 Request processed in 259us (459us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1787790845.517360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:3.0:1787790845.585110:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.585269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250224640 00000100:00100000:2.0:1787790845.585291:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250224640 00000100:00100000:2.0:1787790845.585350:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 227 00000100:00100000:2.0:1787790845.585358:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+64:12456:x1874634250224640:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790845.585379:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790845.585397:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223edf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.585453:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e946 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.585464:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.585472:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790845.585505:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787790845.585508:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790845.585521:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.585538:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223edf expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.585551:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223edf expref: 65 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.585557:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790845.585559:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790845.585561:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790845.585624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250224640:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 267us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.585629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 227 00000100:00100000:3.0:1787790845.589369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790845.589673:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250224768 00000100:00100000:0.0:1787790845.589684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250224768 00000100:00100000:0.0:1787790845.589774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 228 00000100:00100000:0.0:1787790845.589784:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250224768:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790845.589807:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790845.589844:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e94d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ee6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.589909:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.589924:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.589936:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.589946:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.589953:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.589960:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590184:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590195:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590202:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790845.590241:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787790845.590245:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790845.590262:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590292:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590301:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590307:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590313:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590319:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.590324:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590332:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590343:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790845.590346:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.590351:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590358:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e954 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590375:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590380:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590391:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590396:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790845.590399:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590405:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590412:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:0.0:1787790845.590414:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790845.590417:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590422:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e95b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590448:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5600/0xcf9477fddcf1e94d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ee6 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590460:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ee6 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790845.590467:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790845.590469:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790845.590472:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5800, rc 0) 00000100:00100000:0.0:1787790845.590539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+66:12456:x1874634250224768:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 757us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790845.590555:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 228 00000100:00100000:3.0:1787790845.596654:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790845.602399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.602573:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225152 00000100:00100000:2.0:1787790845.602583:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225152 00000100:00100000:2.0:1787790845.602659:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:2.0:1787790845.602669:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+66:2401:x1874634250225152:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790845.602685:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790845.602727:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5800/0xcf9477fddcf1e962 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ee6 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.602750:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790845.602755:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790845.602821:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+65:2401:x1874634250225152:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 153us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.602829:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:1.0:1787790845.603308:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225024 00000100:00100000:1.0:1787790845.603314:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225024 00000100:00100000:1.0:1787790845.603361:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 229 00000100:00100000:1.0:1787790845.603370:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250225024:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790845.603387:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790845.603417:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e969 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223eed expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.603523:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.603544:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 66 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.603924:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.603964:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 66 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.603980:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 66 pid: 10093 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790845.603993:0:10094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268095104:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790845.604078:0:10094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790845.607732:0:10094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1874634268095104:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790845.607765:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790845.610316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.610495:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225280 00000100:00100000:2.0:1787790845.610505:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225280 00010000:00010000:2.0:1787790845.610542:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 67 pid: 10093 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790845.610590:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 101 00000100:00100000:2.0:1787790845.610599:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+67:2402:x1874634250225280:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790845.610612:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790845.610619:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 67 pid: 10093 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.610650:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 67 pid: 10093 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.610673:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4200/0xcf9477fddcf1e938 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed8 expref: 67 pid: 10093 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.610691:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790845.610697:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.610735:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.610746:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.610768:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790845.610815:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+66:2402:x1874634250225280:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 217us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.610822:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 101 00010000:00010000:1.0:1787790845.612096:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.612110:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790845.612160:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787790845.612432:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e969 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 67 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.612453:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 66 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.612462:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:1.0:1787790845.612464:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787790845.612467:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26faa00, rc 0) 00000100:00100000:1.0:1787790845.612533:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+66:12456:x1874634250225024:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 9164us (15889us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787790845.612542:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 229 00000100:00100000:0.0:1787790845.615382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.615486:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225536 00000100:00100000:2.0:1787790845.615495:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225536 00000100:00100000:2.0:1787790845.615547:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:2.0:1787790845.615556:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+66:12456:x1874634250225536:12345-192.168.202.22@tcp:103:lfs.0 00010000:00010000:2.0:1787790845.615643:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790845.615668:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4000/0xcf9477fddcf1e8c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ebc expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.615732:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790845.615739:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790845.615822:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250225536:12345-192.168.202.22@tcp:103:lfs.0 Request processed in 265us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.615830:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787790845.631429:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.631493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225664 00000100:00100000:1.0:1787790845.631504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225664 00000100:00100000:1.0:1787790845.631581:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 230 00000100:00100000:1.0:1787790845.631594:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250225664:12345-192.168.202.22@tcp:58:lfs.0 00010000:00010000:1.0:1787790845.631745:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.631764:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.631776:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790845.631883:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787790845.632005:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250225664:12345-192.168.202.22@tcp:58:lfs.0 Request processed in 408us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.632015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 230 00000100:00100000:3.0:1787790845.634921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790845.634981:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225792 00000100:00100000:2.0:1787790845.634991:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225792 00000100:00100000:2.0:1787790845.635064:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 231 00000100:00100000:2.0:1787790845.635075:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+65:12456:x1874634250225792:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790845.635097:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790845.635119:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223ef4 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.635189:0:10093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.635437:0:10093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 66 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.635460:0:10093:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.635476:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 66 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.635492:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790845.635510:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790845.635515:0:10093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 66 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790845.635523:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994a00, rc 0) 00000100:00100000:2.0:1787790845.635636:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+66:12456:x1874634250225792:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 562us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790845.635644:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 231 00010000:00010000:3.0:1787790845.771723:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787790845.965605:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790845.965616:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790845.965644:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787790845.965654:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790845.965834:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4544000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268095232:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787790845.966215:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c3236180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790845.973858:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4544000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268095232:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787790845.980355:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.980701:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250225920 00000100:00100000:1.0:1787790845.980753:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250225920 00000100:00100000:1.0:1787790845.980826:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 232 00000100:00100000:1.0:1787790845.980837:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+66:12457:x1874634250225920:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790845.980872:0:10094:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790845.980996:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+66:12457:x1874634250225920:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 160us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.981003:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 232 00000100:00100000:3.0:1787790845.987055:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790845.987453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250226048 00000100:00100000:1.0:1787790845.987466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250226048 00000100:00100000:1.0:1787790845.987536:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 233 00000100:00100000:1.0:1787790845.987546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+66:12457:x1874634250226048:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787790845.987621:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987639:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987652:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987756:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987765:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987793:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987820:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987830:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987837:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790845.987889:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787790845.987893:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790845.987907:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987918:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987924:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987931:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987938:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790845.987943:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987951:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987972:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:1.0:1787790845.987976:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790845.987981:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.987988:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e98c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988005:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988011:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988016:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988022:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790845.988024:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988042:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988050:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff916fc2690800) 00010000:00010000:1.0:1787790845.988053:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790845.988056:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988062:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e993 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988088:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988095:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988101:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988106:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fba00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790845.988109:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988114:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988121:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:1.0:1787790845.988123:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790845.988125:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790845.988131:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e99a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790845.988221:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+66:12457:x1874634250226048:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 676us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790845.988230:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 233 00000100:00100000:3.0:1787790846.004358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.005799:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250226304 00000100:00100000:2.0:1787790846.005814:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250226304 00000100:00100000:2.0:1787790846.005906:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 234 00000100:00100000:2.0:1787790846.005918:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+66:12457:x1874634250226304:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790846.005938:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790846.005958:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223efb expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006066:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006081:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006108:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790846.006120:0:10093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787790846.006206:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006213:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006220:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006226:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790846.006230:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006238:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006249:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790846.006252:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787790846.006257:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006263:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006301:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9a1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223efb expref: 68 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006321:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:2.0:1787790846.006323:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790846.006327:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223efb expref: 68 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.006337:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995200, rc 0) 00000100:00100000:2.0:1787790846.006413:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+67:12457:x1874634250226304:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 498us (2065us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1787790846.006420:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 234 00000100:00080000:0.0:1787790846.006497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790846.010375:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.012608:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250226432 00000100:00100000:1.0:1787790846.012625:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250226432 00000100:00100000:1.0:1787790846.012830:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 235 00000100:00100000:1.0:1787790846.012856:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+67:12457:x1874634250226432:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790846.012894:0:10094:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790846.013017:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+67:12457:x1874634250226432:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 163us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.013024:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 235 00000100:00100000:3.0:1787790846.016636:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.016840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250226688 00000100:00100000:0.0:1787790846.016849:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250226688 00000100:00100000:0.0:1787790846.016910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 236 00000100:00100000:0.0:1787790846.016920:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+67:12457:x1874634250226688:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790846.016941:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790846.016944:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787790846.016969:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1e946 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223edf expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.016990:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790846.016996:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790846.017011:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e9b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f02 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787790846.017429:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787790846.017562:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e9bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.017577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e9bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.017587:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e9bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.017658:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e9b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f02 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.017678:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e9bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f02 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.017686:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8300) 00010000:00010000:0.0:1787790846.017689:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790846.017691:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5e00, rc 0) 00000100:00100000:0.0:1787790846.017794:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+68:12457:x1874634250226688:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 875us (1169us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787790846.017802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 236 00000100:00100000:0.0:1787790846.024613:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.024906:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250226944 00000100:00100000:2.0:1787790846.024915:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250226944 00000100:00100000:2.0:1787790846.024985:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 237 00000100:00100000:2.0:1787790846.024995:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+68:12457:x1874634250226944:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790846.025526:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790846.025557:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5e00/0xcf9477fddcf1e9bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f02 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025582:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8300) 00010000:00010000:2.0:1787790846.025595:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790846.025617:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025631:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025641:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025672:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025680:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025688:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025891:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025899:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025907:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025914:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790846.025919:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025926:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025936:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:2.0:1787790846.025940:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790846.025944:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025952:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1e9cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025970:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025976:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025982:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025986:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790846.025990:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.025996:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.026004:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe2095981 (ffff916fc3701a00) 00010000:00010000:2.0:1787790846.026007:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790846.026010:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.026016:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe2095981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.026373:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+67:12457:x1874634250226944:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1377us (1768us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790846.026383:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 237 00000100:00100000:3.0:1787790846.035831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.035986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250227072 00000100:00100000:0.0:1787790846.035995:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250227072 00000100:00100000:0.0:1787790846.036065:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 238 00000100:00100000:0.0:1787790846.036075:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+67:12457:x1874634250227072:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790846.036096:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790846.036120:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e9d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.036169:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.036183:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.036217:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.036509:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1e9d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.036533:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.036542:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:0.0:1787790846.036546:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790846.036549:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5a00, rc 0) 00000100:00100000:0.0:1787790846.036618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+68:12457:x1874634250227072:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 544us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.036626:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 238 00000100:00100000:3.0:1787790846.040690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.040841:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250227328 00000100:00100000:1.0:1787790846.040851:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250227328 00000100:00100000:1.0:1787790846.040919:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 239 00000100:00100000:1.0:1787790846.040929:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+68:12457:x1874634250227328:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790846.041014:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.041032:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.041043:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790846.041228:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787790846.041239:0:10094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394989533182ns, next at 395989530452ns, rc = 0 00000004:00010000:1.0:1787790846.041287:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffe44806 reply state 00000000b7e0e62f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.041306:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.041315:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:1.0:1787790846.041318:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787790846.041334:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790846.041446:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+70:12457:x1874634250227328:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 517us (766us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787790846.041455:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 239 00000100:00100000:3.0:1787790846.045031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.045116:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250227456 00000100:00100000:2.0:1787790846.045126:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250227456 00000100:00100000:2.0:1787790846.045205:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 240 00000100:00100000:2.0:1787790846.045233:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ce928850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+70:12457:x1874634250227456:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790846.045259:0:10093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790846.045280:0:10093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f10 expref: -99 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.045339:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 71 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.045354:0:10093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 71 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.045373:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:2.0:1787790846.045376:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790846.045381:0:10093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994c00, rc 0) 00000100:00100000:2.0:1787790846.045449:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ce928850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+71:12457:x1874634250227456:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 219us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.045457:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 240 00000100:00100000:3.0:1787790846.057494:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.058587:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250227584 00000100:00100000:1.0:1787790846.058599:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250227584 00000100:00100000:1.0:1787790846.058681:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:1.0:1787790846.058691:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+9:2402:x1874634250227584:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787790846.058934:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+10:2402:x1874634250227584:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 243us (1446us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787790846.058942:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00080000:0.0:1787790846.059110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790846.062201:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.062293:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250227840 00000100:00100000:1.0:1787790846.062302:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250227840 00000100:00100000:1.0:1787790846.062358:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:1.0:1787790846.062369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+71:12457:x1874634250227840:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787790846.062587:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+72:12457:x1874634250227840:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 220us (394us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1787790846.062595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:3.0:1787790846.065433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.065560:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228096 00000100:00100000:0.0:1787790846.065571:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228096 00000100:00100000:0.0:1787790846.065634:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 241 00000100:00100000:0.0:1787790846.065646:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+72:12457:x1874634250228096:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787790846.065802:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+72:12457:x1874634250228096:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 158us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.065810:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 241 00000100:00100000:2.0:1787790846.070244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.070855:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228224 00000100:00100000:1.0:1787790846.070866:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228224 00000100:00100000:1.0:1787790846.070934:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 242 00000100:00100000:1.0:1787790846.070945:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+72:12457:x1874634250228224:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790846.070967:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790846.070989:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e9f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f17 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.071099:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e9fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.071115:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e9fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.071128:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e9fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790846.071183:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790846.071203:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e9fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.071231:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1e9f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f17 expref: 74 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.071250:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e9fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f17 expref: 73 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.071258:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:1.0:1787790846.071261:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787790846.071265:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb400, rc 0) 00000100:00100000:1.0:1787790846.071338:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+73:12457:x1874634250228224:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 394us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.071347:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 242 00000100:00100000:3.0:1787790846.077141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.077513:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228352 00000100:00100000:1.0:1787790846.077523:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228352 00000100:00100000:1.0:1787790846.077583:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 71 00000100:00100000:1.0:1787790846.077607:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+10:2403:x1874634250228352:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790846.077627:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790846.077648:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f1e expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790846.077685:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f85ff, blocks: 0x0 00010000:00010000:1.0:1787790846.077749:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1787790846.077755:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790846.077765:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.077785:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.077799:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:1.0:1787790846.077865:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+11:2403:x1874634250228352:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 260us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.077873:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 71 00000100:00100000:3.0:1787790846.080469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.080626:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228608 00000100:00100000:1.0:1787790846.080636:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228608 00000100:00100000:1.0:1787790846.080686:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 243 00000100:00100000:1.0:1787790846.080696:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+73:12457:x1874634250228608:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790846.081200:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+73:12457:x1874634250228608:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 504us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.081210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 243 00000100:00100000:2.0:1787790846.083536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.083692:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228736 00000100:00100000:1.0:1787790846.083701:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228736 00000100:00100000:1.0:1787790846.083852:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:1.0:1787790846.083862:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+11:12457:x1874634250228736:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790846.083880:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790846.083898:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f25 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.083923:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.083930:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790846.083933:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790846.083936:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.083964:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.083973:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 12 pid: 8426 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.083983:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268095360:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790846.084048:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790846.086477:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.086609:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228864 00000100:00100000:2.0:1787790846.086619:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228864 00010000:00010000:2.0:1787790846.086668:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 13 pid: 8426 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.086731:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:2.0:1787790846.086740:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+13:2402:x1874634250228864:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790846.086767:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790846.086791:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 13 pid: 8426 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.086805:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 13 pid: 8426 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.086831:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790846.086836:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790846.086846:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.086866:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.086903:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.086917:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1874634268095488:192.168.202.22@tcp:105: 00000100:00100000:2.0:1787790846.087003:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c3236180 going to sleep for 11 seconds 00010000:00010000:1.0:1787790846.087897:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f1e expref: 13 pid: 8426 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.087932:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268095360:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790846.087958:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.087970:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbe00, rc 0) 00000100:00100000:1.0:1787790846.088059:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+12:12457:x1874634250228736:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 4198us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.088068:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:3.0:1787790846.094740:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.094970:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250228992 00000100:00100000:0.0:1787790846.094980:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250228992 00002000:00100000:0.0:1787790846.095045:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff916fc45892c0 x1874634250228992/t0(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:687/0 lens 504/0 e 0 to 0 dl 1787790857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790846.095055:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc45892c0 with x1874634250228992 ext(0->12) 00002000:00010000:0.0:1787790846.095060:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc45892c0 00000100:00100000:0.0:1787790846.095090:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:0.0:1787790846.095099:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a61a333f-852a-40de-8207-4f7de209a9a4+12:2402:x1874634250228992:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787790846.095263:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1874634268095488:192.168.202.22@tcp:105: 00010000:00010000:2.0:1787790846.095286:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790846.095341:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61a333f-852a-40de-8207-4f7de209a9a4+12:2402:x1874634250228864:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 8602us (8874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.095351:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 102 00000100:00100000:0.0:1787790846.097352:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a61a333f-852a-40de-8207-4f7de209a9a4+13:2402:x1874634250228992:12345-192.168.202.22@tcp:4:lhsmtool_posix.0 Request processed in 2246us (2611us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787790846.097365:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00002000:00100000:0.0:1787790846.097377:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff916fc45892c0 x1874634250228992/t4294967321(0) o4->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:687/0 lens 504/448 e 0 to 0 dl 1787790857 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790846.097386:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc45892c0 with x1874634250228992 ext(0->12) 00002000:00010000:0.0:1787790846.097392:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc45892c0 00000100:00100000:3.0:1787790846.100612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.100702:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250229120 00000100:00100000:2.0:1787790846.100744:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250229120 00000100:00100000:2.0:1787790846.100806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 244 00000100:00100000:2.0:1787790846.100817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+73:12457:x1874634250229120:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787790846.108224:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1787790846.108241:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787790846.108311:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787790846.108336:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170fbec5c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787790846.108341:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170d63ca500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170fbec5b40 00000020:00080000:3.0:1787790846.108344:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170c648d800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9170e5ed1a00 00000020:00080000:3.0:1787790846.108393:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170d00eb9c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787790846.108396:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff916fc37c3100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170d00eb480 00000020:00080000:3.0:1787790846.108399:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff916fc37c3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff917101135000 00000100:00100000:1.0:1787790846.108632:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790846.108652:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268095616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787790846.108745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.108805:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268095616 00000100:00100000:1.0:1787790846.108812:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268095616 00000100:00100000:1.0:1787790846.108860:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787790846.108869:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3640:x1874634268095616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787790846.108895:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1787790846.108927:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f85fe, atime: 0x6a8f85fe, ctime: 0x6a8f85fe, blocks: 0x8 00010000:00010000:1.0:1787790846.108935:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.108950:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1787790846.108954:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790846.108960:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.108988:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.108999:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109008:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109026:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790846.109168:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3640:x1874634268095616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (422us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787790846.109176:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1787790846.109318:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790846.109325:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109334:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790846.109339:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109349:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109366:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109379:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ea11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.109399:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790846.109401:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790846.109402:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787790846.109436:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff916fc45b2580/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787790846.109442:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268095616:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787790846.109669:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787790846.109728:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787790846.109741:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268095872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787790846.109773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.109795:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790846.109801:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268095744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787790846.109822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.109846:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268095872 00000100:00100000:1.0:1787790846.110030:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268095744 00000100:00100000:1.0:1787790846.110035:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268095744 00000100:00100000:1.0:1787790846.110073:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787790846.110079:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268095744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787790846.110097:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1787790846.110113:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.110131:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.110138:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787790846.110141:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00000100:00100000:2.0:1787790846.111122:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268095872 00000100:00100000:2.0:1787790846.111176:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787790846.111184:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1874634268095872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787790846.111495:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787790846.111499:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787790847 00002000:00010000:2.0:1787790846.111502:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787790846.111504:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787790847 -> 1787790847 00002000:00010000:2.0:1787790846.111506:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787790846.111629:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.111666:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.111692:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 12 pid: 8428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.111722:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268096000:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790846.111801:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1787790846.111815:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790846.111881:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3639:x1874634268095872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 697us (2106us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787790846.111890:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787790846.111978:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+27:12457:x1874634250229120:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 11164us (11377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.111986:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 244 00010000:00010000:0.0:1787790846.113124:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113137:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113153:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113159:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790846.113165:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113172:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113212:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff916fc3702b00) 00010000:00010000:0.0:1787790846.113215:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790846.113220:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113227:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1e70f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113267:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113274:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113279:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113284:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790846.113287:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113293:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113301:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff916fc2690b00) 00010000:00010000:0.0:1787790846.113303:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790846.113306:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113312:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4800/0xcf9477fddcf1e7b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113343:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113350:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113357:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113362:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790846.113365:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113371:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113379:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:0.0:1787790846.113381:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790846.113383:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113389:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1e835 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113401:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113407:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113414:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113425:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790846.113428:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113434:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113442:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc2690d00) 00010000:00010000:0.0:1787790846.113444:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790846.113447:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113452:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1e858 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113468:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113474:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113480:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113484:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790846.113487:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113493:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113511:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790846.113513:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790846.113516:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113522:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1e92a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113535:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113541:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113547:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113552:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fba00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790846.113554:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113560:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113568:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:0.0:1787790846.113570:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787790846.113573:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.113578:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fba00/0xcf9477fddcf1e9e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790846.117317:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff916fc4547480/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787790846.117334:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268095872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787790846.117569:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.117641:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.117884:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250229248 00000100:00100000:2.0:1787790846.117891:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250229248 00000100:00100000:2.0:1787790846.117935:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 76 00000100:00100000:2.0:1787790846.117943:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+13:2403:x1874634250229248:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787790846.119536:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250229376 00000100:00100000:3.0:1787790846.119547:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250229376 00010000:00010000:3.0:1787790846.119580:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 14 pid: 8428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790846.119619:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 103 00000100:00100000:3.0:1787790846.119627:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:2403:x1874634250229376:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787790846.119639:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787790846.119645:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 14 pid: 8428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.119659:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 14 pid: 8428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.119684:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790846.119688:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787790846.119702:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.119749:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.119769:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787790846.119829:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+14:2403:x1874634250229376:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 202us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790846.119836:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 103 00000001:00080000:2.0:1787790846.121657:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1787790846.121674:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1787790846.121906:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250229248:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 3956us (4258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790846.121917:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 76 00010000:00010000:1.0:1787790846.123252:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1e7c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e7d expref: 7 pid: 8428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.123280:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1874634268096000:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790846.123302:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.123314:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.123322:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.123332:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.123340:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.123379:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790846.123573:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268095744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13492us (13748us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787790846.123585:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787790846.123675:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787790846.123689:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1787790846.123755:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff916fc4547480, transno 4294967322 00000100:00100000:3.0:1787790846.123786:0:3639:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff916fc4546580 x1874634268095744/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787790862 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787790846.123801:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff916fc4546580/2, rc 0, transno 4294967323 00000100:00100000:3.0:1787790846.123807:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268095744:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787790846.124063:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790846.124072:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.124083:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790846.124087:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.124096:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.124116:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.124124:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000693d28e5/0xcf9477fddcf1ea18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.124159:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790846.124162:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790846.124163:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790846.128596:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.128673:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250229632 00000100:00100000:2.0:1787790846.128696:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250229632 00000100:00100000:2.0:1787790846.128799:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 245 00000100:00100000:2.0:1787790846.128809:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+21:12457:x1874634250229632:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787790846.128878:0:10093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790846.128907:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb400/0xcf9477fddcf1e9fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f17 expref: 21 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.128925:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:2.0:1787790846.128932:0:10093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790846.128963:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.128977:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.128986:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787790846.129109:0:10093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b9cde1 reply state 000000004b4fb823 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.129123:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.129129:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:2.0:1787790846.129132:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787790846.129135:0:10093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787790846.129252:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+22:12457:x1874634250229632:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 443us (666us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787790846.129271:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 245 00000100:00100000:2.0:1787790846.133112:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.133209:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250229760 00000100:00100000:1.0:1787790846.133219:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250229760 00000100:00100000:1.0:1787790846.133303:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 77 00000100:00100000:1.0:1787790846.133314:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250229760:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787790846.133464:0:10092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787790846.133468:0:10092:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787790847 -> 1787790846 00002000:00010000:1.0:1787790846.133470:0:10092:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787790846 00002000:00010000:1.0:1787790846.133472:0:10092:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787790847 -> 1787790846 00002000:00010000:1.0:1787790846.133474:0:10092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787790846.133536:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:2402:x1874634250229760:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 224us (434us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787790846.133544:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 77 00000100:00100000:3.0:1787790846.139113:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.139223:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230016 00000100:00100000:1.0:1787790846.139233:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230016 00000100:00100000:1.0:1787790846.139326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 246 00000100:00100000:1.0:1787790846.139337:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:12457:x1874634250230016:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787790846.139405:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.139422:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.139453:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.139487:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.139500:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 22 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.139515:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268096128:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790846.139598:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790846.144088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.144426:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230144 00000100:00100000:0.0:1787790846.144436:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230144 00010000:00010000:0.0:1787790846.144478:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 23 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790846.144523:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 104 00000100:00100000:0.0:1787790846.144533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:2403:x1874634250230144:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790846.144547:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790846.144554:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 23 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.144567:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 23 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.144588:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:0.0:1787790846.144593:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.144603:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.144609:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.144628:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790846.144690:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+23:2403:x1874634250230144:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 158us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.144699:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 104 00010000:00010000:1.0:1787790846.145142:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5a00/0xcf9477fddcf1e9e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f09 expref: 22 pid: 6512 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.145175:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268096128:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787790846.145198:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145207:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145214:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145269:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145276:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145301:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145307:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790846.145311:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145319:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145329:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:1.0:1787790846.145332:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787790846.145337:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.145342:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1ea26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.145389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:12457:x1874634250230016:12345-192.168.202.22@tcp:55:lhsmtool_posix.0 Request processed in 6054us (6286us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787790846.145397:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 246 00000100:00100000:3.0:1787790846.148103:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.148203:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230272 00000100:00100000:2.0:1787790846.148213:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230272 00000100:00100000:2.0:1787790846.148278:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:2.0:1787790846.148294:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250230272:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787790846.148338:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.148358:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.148367:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790846.148372:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790846.148377:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.148409:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.148423:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 8 pid: 8427 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.148437:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1874634268096256:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790846.148512:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c55b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790846.152492:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1874634268096256:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790846.152529:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790846.153897:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.154128:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230400 00000100:00100000:2.0:1787790846.154137:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230400 00010000:00010000:2.0:1787790846.154187:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 9 pid: 8427 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.154241:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 105 00000100:00100000:2.0:1787790846.154252:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+9:2403:x1874634250230400:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790846.154484:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790846.154507:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 9 pid: 8427 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.154522:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 9 pid: 8427 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.154545:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e480451/0xcf9477fddcf1ea0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f25 expref: 9 pid: 8427 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.154562:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790846.154567:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787790846.154572:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.154581:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.154628:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790846.154807:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154828:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154848:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154856:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154865:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154871:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790846.154876:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154884:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154895:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.154903:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1ea2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.155013:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:2403:x1874634250230400:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 762us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.155022:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 105 00000100:00100000:3.0:1787790846.159553:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250230272:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 11253us (11446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790846.159569:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:3.0:1787790846.163576:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.163646:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230656 00000100:00100000:2.0:1787790846.163657:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230656 00000100:00100000:2.0:1787790846.163742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 247 00000100:00100000:2.0:1787790846.163752:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+21:12457:x1874634250230656:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787790846.163841:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.163858:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 21 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.163869:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.163907:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 21 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.163921:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 21 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.163936:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268096384:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790846.164014:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c55b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790846.167848:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.167932:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230784 00000100:00100000:0.0:1787790846.167940:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230784 00010000:00010000:0.0:1787790846.167978:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 22 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790846.168024:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 106 00000100:00100000:0.0:1787790846.168034:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:2403:x1874634250230784:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790846.168047:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790846.168055:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 22 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.168069:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 22 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.168091:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790846.168096:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 22 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.168106:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.168113:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.168122:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.168166:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790846.168218:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:2403:x1874634250230784:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 186us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.168226:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 106 00010000:00010000:2.0:1787790846.170073:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1e923 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ed1 expref: 21 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.170112:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268096384:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790846.170138:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170159:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170166:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170514:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170529:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 21 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170538:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170569:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 21 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.170583:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 21 pid: 10093 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.170597:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268096512:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790846.170749:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e5d040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790846.174123:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268096512:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790846.174160:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790846.176823:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.177300:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250230912 00000100:00100000:0.0:1787790846.177311:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250230912 00010000:00010000:0.0:1787790846.177353:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 22 pid: 10093 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790846.177443:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 107 00000100:00100000:0.0:1787790846.177454:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+22:2403:x1874634250230912:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790846.177470:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790846.177478:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 22 pid: 10093 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.177490:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 22 pid: 10093 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.177514:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1e9ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f10 expref: 22 pid: 10093 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.177529:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:0.0:1787790846.177533:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.177541:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.177564:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.177604:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790846.177642:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.177651:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790846.177669:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a61a333f-852a-40de-8207-4f7de209a9a4+21:2403:x1874634250230912:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 217us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.177677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 107 00000001:00080000:1.0:1787790846.179331:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787790846.179472:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1787790846.179507:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1787790846.179610:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874634268096640:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787790846.179674:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.179809:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790846.180648:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268096640 00000100:00100000:3.0:1787790846.180658:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268096640 00000100:00100000:3.0:1787790846.180755:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787790846.180766:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1874634268096640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787790846.181051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1874634268096640:12345-0@lo:1000:mdt00_002.0 Request processed in 286us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790846.181059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787790846.182063:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874634268096640:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787790846.182449:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787790846.182525:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874634268096768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787790846.182581:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.182621:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790846.182753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268096768 00000100:00100000:2.0:1787790846.182759:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268096768 00000100:00100000:2.0:1787790846.182816:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787790846.182826:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1874634268096768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787790846.183222:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6514:x1874634268096768:12345-0@lo:1000:mdt00_002.0 Request processed in 397us (640us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787790846.183231:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787790846.183549:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874634268096768:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787790846.183594:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183606:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183613:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183619:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790846.183624:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183631:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183648:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:1.0:1787790846.183651:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790846.183656:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183680:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1ea3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183722:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183729:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183735:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183739:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790846.183742:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183748:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183756:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:1.0:1787790846.183758:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790846.183765:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 24 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183776:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 24 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183921:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 24 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.183966:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 24 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.183980:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268096896:192.168.202.22@tcp:105: 00000100:00100000:1.0:1787790846.184112:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790846.189370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.189425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250231040 00000100:00100000:0.0:1787790846.189435:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250231040 00000100:00100000:0.0:1787790846.189486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:0.0:1787790846.189496:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+25:12456:x1874634250231040:12345-192.168.202.22@tcp:49:lfs.0 00000100:00100000:2.0:1787790846.189666:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874634268096896:192.168.202.22@tcp:105: 00010000:00010000:2.0:1787790846.189694:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189724:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1e97e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189756:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189769:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189781:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189803:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189810:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189831:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189837:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790846.189841:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189848:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189860:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790846.189864:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790846.189867:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189872:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea42 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189881:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189887:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189893:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189898:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790846.189901:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189917:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189926:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790846.189928:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790846.189931:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.189936:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea34 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790846.190141:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790846.190154:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790846.190644:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787790846.190656:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787790846.191521:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+25:12456:x1874634250231040:12345-192.168.202.22@tcp:49:lfs.0 Request processed in 2019us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.191534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:2.0:1787790846.191642:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+24:12457:x1874634250230656:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 27889us (28074us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787790846.191652:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 247 00000020:00080000:2.0:1787790846.191657:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787790846.199018:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.200451:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790846.200539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250231552 00000100:00100000:2.0:1787790846.200548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250231552 00000100:00100000:2.0:1787790846.200602:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:2.0:1787790846.200612:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c80ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+24:12457:x1874634250231552:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787790846.201247:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787790846.201455:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787790846.201499:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.201516:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.201543:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.201552:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.201557:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.201563:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.201590:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787790846.201675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c80ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+26:12457:x1874634250231552:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 1063us (1228us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787790846.201685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000020:00080000:2.0:1787790846.201690:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787790846.201821:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790846.201829:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.201835:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790846.201839:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.201846:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.202016:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:1.0:1787790846.202019:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787790846.202024:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.202030:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1ea49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790846.202042:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790846.202050:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790846.202052:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790846.202112:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250231296 00000100:00100000:0.0:1787790846.202120:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250231296 00000100:00100000:0.0:1787790846.202252:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 248 00000100:00100000:0.0:1787790846.202444:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+26:12456:x1874634250231296:12345-192.168.202.22@tcp:58:lfs.0 00000040:00080000:0.0:1787790846.202577:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787790846.202626:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+26:12456:x1874634250231296:12345-192.168.202.22@tcp:58:lfs.0 Request processed in 366us (3618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.202633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 248 00000100:00100000:2.0:1787790846.255270:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.256534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250231680 00000100:00100000:1.0:1787790846.256548:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250231680 00000100:00100000:2.0:1787790846.256749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 249 00000100:00100000:2.0:1787790846.256761:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+26:12459:x1874634250231680:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790846.256796:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790846.256819:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f2c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.256896:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.256912:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.256938:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.256953:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.256961:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.256968:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.257046:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.257056:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 27 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.257064:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.257113:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 27 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790846.257137:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 27 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790846.257161:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45461c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268097024:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790846.257271:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c567cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790846.261747:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790846.261835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250231936 00000100:00100000:1.0:1787790846.261844:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250231936 00000100:00100000:1.0:1787790846.261909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:1.0:1787790846.261919:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+28:6167:x1874634250231936:12345-192.168.202.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787790846.262124:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+29:6167:x1874634250231936:12345-192.168.202.22@tcp:35:ldlm_bl.0 Request processed in 205us (429us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787790846.262131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:3.0:1787790846.262765:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45461c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874634268097024:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790846.262794:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790846.266357:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790846.266576:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250232064 00000100:00100000:0.0:1787790846.266587:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250232064 00010000:00010000:0.0:1787790846.266631:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 29 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790846.266695:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 108 00000100:00100000:0.0:1787790846.266734:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+29:2403:x1874634250232064:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790846.266750:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790846.266757:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 29 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.266771:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 29 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.266807:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1e970 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223eed expref: 29 pid: 10094 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.266823:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790846.266829:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.266841:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.266848:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790846.266878:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790846.266931:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61a333f-852a-40de-8207-4f7de209a9a4+28:2403:x1874634250232064:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 227us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790846.266939:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 108 00010000:00010000:3.0:1787790846.267135:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267155:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790846.267208:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787790846.267213:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787790846.267243:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267268:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267278:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267284:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267298:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267305:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790846.267308:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267315:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267324:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:3.0:1787790846.267327:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790846.267333:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267340:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1ea57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267351:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267357:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267370:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267375:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790846.267380:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267386:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267395:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff916fc3701b00) 00010000:00010000:3.0:1787790846.267397:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790846.267400:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267406:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1ea5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267440:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1ea50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f2c expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267454:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f2c expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790846.267461:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:3.0:1787790846.267463:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790846.267466:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994000, rc 0) 00000100:00100000:3.0:1787790846.267494:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+27:12459:x1874634250231680:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 10736us (12242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790846.267513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 249 00000100:00100000:1.0:1787790846.284135:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268097408:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.284273:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268097920:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.284323:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268098432:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.284361:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787790846.284367:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268097536:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.284410:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268098048:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.284448:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268098560:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790846.284508:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098560 00000100:00100000:1.0:1787790846.284532:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098560 00000100:00100000:1.0:1787790846.284596:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787790846.284605:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268098560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.284657:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268098560:12345-0@lo:400:kworker.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.284663:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1787790846.284684:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787790846.284695:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097536 00000100:00100000:1.0:1787790846.284698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097536 00000100:00100000:1.0:1787790846.284771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787790846.284778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268097536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.285759:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268097536:12345-0@lo:400:kworker.0 Request processed in 979us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790846.285769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787790846.285914:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268097152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790846.285954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.285984:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268097664:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.286025:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268098176:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.286065:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268098688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790846.286087:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.286111:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787790846.286118:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268097280:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.286196:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268097792:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.286250:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268098304:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790846.286308:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097152 00000100:00100000:2.0:1787790846.286315:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097152 00000100:00100000:2.0:1787790846.286352:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098688 00000100:00100000:2.0:1787790846.286355:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098688 00000100:00100000:2.0:1787790846.286371:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787790846.286380:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268097152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787790846.286400:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787790846.286439:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268097152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.286444:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787790846.286475:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787790846.286482:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268098688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790846.286493:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787790846.286520:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268098688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.286525:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787790846.286543:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098176 00000100:00100000:2.0:1787790846.286546:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098176 00000100:00100000:2.0:1787790846.286579:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787790846.286586:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268098176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286617:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268098176:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.286623:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787790846.286643:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097280 00000100:00100000:2.0:1787790846.286647:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097280 00000100:00100000:2.0:1787790846.286670:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787790846.286676:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268097280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286726:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3640:x1874634268097280:12345-0@lo:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.286733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:2.0:1787790846.286762:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790846.286773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097664 00000100:00100000:2.0:1787790846.286776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097664 00000100:00100000:2.0:1787790846.286807:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787790846.286812:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268097664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286844:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268097664:12345-0@lo:400:kworker.0 Request processed in 32us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.286860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787790846.286895:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268097280:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286914:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268097152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790846.286923:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268097664:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286933:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268098176:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.286946:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268098688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790846.286982:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097408 00000100:00100000:2.0:1787790846.286986:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097408 00000100:00100000:2.0:1787790846.287005:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097920 00000100:00100000:2.0:1787790846.287008:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097920 00000100:00080000:2.0:1787790846.287024:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790846.287036:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098432 00000100:00100000:2.0:1787790846.287039:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098432 00000100:00080000:2.0:1787790846.287051:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790846.287064:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098048 00000100:00100000:2.0:1787790846.287067:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098048 00000100:00080000:2.0:1787790846.287077:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790846.287089:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268097792 00000100:00100000:2.0:1787790846.287092:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268097792 00000100:00100000:2.0:1787790846.287101:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098304 00000100:00100000:2.0:1787790846.287104:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098304 00000100:00080000:2.0:1787790846.287114:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790846.287131:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787790846.287136:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268097408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287183:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268097408:12345-0@lo:400:kworker.0 Request processed in 47us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.287190:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787790846.287209:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787790846.287216:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268097920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287247:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268097920:12345-0@lo:400:kworker.0 Request processed in 32us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.287253:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787790846.287265:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787790846.287271:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268098432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287296:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268098432:12345-0@lo:400:kworker.0 Request processed in 26us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.287302:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787790846.287313:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787790846.287318:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268098048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287346:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268098048:12345-0@lo:400:kworker.0 Request processed in 28us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.287351:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787790846.287363:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787790846.287369:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268097792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287401:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268097792:12345-0@lo:400:kworker.0 Request processed in 32us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.287407:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787790846.287431:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268097792:0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287448:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787790846.287455:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268098304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790846.287487:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268098304:12345-0@lo:400:kworker.0 Request processed in 33us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790846.287501:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787790846.287527:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268098304:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.288445:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268097536:0@lo:400:kworker.0 00010000:00080000:1.0:1787790846.288461:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f52c0 x1874634268098048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790846.288472:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268098048:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.288482:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268098560:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.288493:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268097408:0@lo:400:kworker.0 00000100:00100000:1.0:1787790846.288503:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268097920:0@lo:400:kworker.0 00010000:00080000:1.0:1787790846.288513:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d61c0 x1874634268098432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790846.288520:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268098432:0@lo:400:kworker.0 00000001:00080000:2.0:1787790846.481915:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787790846.481945:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:1.0:1787790846.799577:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787790847.218098:0:14698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787790847.218261:0:14698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787790847.218307:0:14698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787790847.218317:0:14698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787790847.249628:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790847.249645:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790847.249677:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787790847.249686:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787790847.249928:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268098816:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787790847.250052:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790847.257889:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13789:1874634268098816:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787790847.270968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.271941:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250232192 00000100:00100000:3.0:1787790847.271958:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250232192 00000100:00100000:1.0:1787790847.272113:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 250 00000100:00100000:1.0:1787790847.272125:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+27:12470:x1874634250232192:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787790847.272255:0:10093:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787790847.272482:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+27:12470:x1874634250232192:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 358us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790847.272490:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 250 00000100:00100000:1.0:1787790847.277886:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790847.277970:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250232448 00000100:00100000:2.0:1787790847.277982:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250232448 00000100:00100000:2.0:1787790847.278068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 251 00000100:00100000:2.0:1787790847.278080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+27:12470:x1874634250232448:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790847.278109:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790847.278146:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1ea6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.278311:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1ea73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.278331:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.278347:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790847.278361:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787790847.278549:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995a00/0xcf9477fddcf1ea6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f33 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.278566:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1ea73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f33 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.278577:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790847.278580:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790847.278584:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995000, rc 0) 00000100:00100000:2.0:1787790847.278674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61a333f-852a-40de-8207-4f7de209a9a4+29:12470:x1874634250232448:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 596us (1658us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787790847.278683:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 251 00000100:00100000:3.0:1787790847.283654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.283747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790847.283817:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250232832 00000100:00100000:2.0:1787790847.283832:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250232832 00000100:00100000:2.0:1787790847.283943:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787790847.283956:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+29:2400:x1874634250232832:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790847.283982:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790847.284015:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1ea73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f33 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790847.284040:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:2.0:1787790847.284047:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790847.284125:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a61a333f-852a-40de-8207-4f7de209a9a4+28:2400:x1874634250232832:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 171us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790847.284146:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:0.0:1787790847.284234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250232704 00000100:00100000:0.0:1787790847.284239:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250232704 00000100:00100000:0.0:1787790847.284285:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 252 00000100:00100000:0.0:1787790847.284294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+28:12470:x1874634250232704:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787790847.284488:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.284508:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285215:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285876:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285888:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285896:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285904:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790847.285908:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285917:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285934:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790847.285938:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787790847.285958:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790847.285965:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5200/0xcf9477fddcf1ea81 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790847.286196:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790847.286202:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787790847.287236:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+29:12470:x1874634250232704:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 1840us (2495us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787790847.287253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 252 00000040:00080000:2.0:1787790847.287324:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787790847.287338:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790847.289239:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790847.289320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233088 00000100:00100000:2.0:1787790847.289333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233088 00000100:00100000:2.0:1787790847.289404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:2.0:1787790847.289417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+29:12470:x1874634250233088:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787790847.289834:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+30:12470:x1874634250233088:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 419us (608us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787790847.289844:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:3.0:1787790847.433571:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.433627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.433674:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.433746:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.433783:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.433810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790847.433846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233728 00000100:00100000:3.0:1787790847.433862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233728 00000100:00100000:3.0:1787790847.433945:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233344 00000100:00100000:3.0:1787790847.433948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233344 00000100:00100000:3.0:1787790847.433964:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233856 00000100:00100000:3.0:1787790847.433968:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233856 00000100:00100000:3.0:1787790847.433986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 310 00000100:00100000:3.0:1787790847.433998:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250233728:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790847.434098:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250233728:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 102us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790847.434106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 310 00000100:00100000:3.0:1787790847.434125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 311 00000100:00100000:3.0:1787790847.434162:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250233344:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790847.434190:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250233344:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790847.434209:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 311 00000100:00100000:3.0:1787790847.434223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 312 00000100:00100000:3.0:1787790847.434229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250233856:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790847.434254:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250233856:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790847.434260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 312 00000100:00100000:1.0:1787790847.434740:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233216 00000100:00100000:1.0:1787790847.434747:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233216 00000100:00100000:1.0:1787790847.434796:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 387 00000100:00100000:1.0:1787790847.434805:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250233216:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790847.434842:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250233216:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 38us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790847.434848:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 387 00000100:00100000:0.0:1787790847.435564:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233472 00000100:00100000:0.0:1787790847.435570:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233472 00000100:00100000:0.0:1787790847.435607:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250233600 00000100:00100000:0.0:1787790847.435609:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250233600 00000100:00100000:0.0:1787790847.435626:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:0.0:1787790847.435631:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250233472:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790847.435665:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250233472:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 35us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790847.435670:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:0.0:1787790847.435678:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:0.0:1787790847.435682:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250233600:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790847.435695:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250233600:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 13us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790847.435699:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00080000:2.0:1787790847.436141:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787790847.436149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790847.436153:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790847.819595:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790848.139588:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787790848.331042:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790848.331056:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790848.331081:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787790848.331094:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790848.842957:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787790848.844247:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790848.844938:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268098944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790848.845070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790848.845989:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790848.846007:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268099072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790848.846077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790848.847942:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268098944 00000100:00100000:2.0:1787790848.847959:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268098944 00000100:00100000:2.0:1787790848.848059:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099072 00000100:00100000:2.0:1787790848.848064:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099072 00000100:00100000:2.0:1787790848.848091:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787790848.848103:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268098944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790848.848159:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790848.848324:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268098944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 223us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790848.848333:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787790848.848369:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787790848.848377:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268099072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787790848.848388:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790848.848425:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268099072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790848.848431:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787790848.848513:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787790848.848522:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1787790848.848568:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff916fc3b16580, transno 4294967308 00000004:00080000:2.0:1787790848.848582:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787790848.848608:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff916fc45b2580, transno 4294967311 00000100:00100000:2.0:1787790848.848626:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268099072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790848.848867:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268098944:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787790848.849049:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787790849.149043:0:14749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787790849.149055:0:14749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787790849.149092:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787790849.149101:0:14749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787790849.324673:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790849.324761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234112 00000100:00100000:1.0:1787790849.324775:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234112 00000100:00100000:1.0:1787790849.325169:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 253 00000100:00100000:1.0:1787790849.325184:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+30:12491:x1874634250234112:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790849.325220:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790849.325261:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1ea88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790849.325417:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1ea8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790849.325436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790849.325452:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790849.325465:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787790849.325603:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa800/0xcf9477fddcf1ea88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f3a expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790849.325621:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1ea8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f3a expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790849.325630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:1.0:1787790849.325634:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787790849.325637:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:1.0:1787790849.325747:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+32:12491:x1874634250234112:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 568us (1088us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787790849.325755:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 253 00000100:00080000:1.0:1787790849.325787:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790849.328590:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790849.328701:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234240 00000100:00100000:0.0:1787790849.328737:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234240 00000100:00100000:0.0:1787790849.328815:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 254 00000100:00100000:0.0:1787790849.328830:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+32:12491:x1874634250234240:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:0.0:1787790849.329281:0:10093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329305:0:10093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329321:0:10093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329506:0:10093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329515:0:10093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329522:0:10093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329529:0:10093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790849.329535:0:10093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329543:0:10093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329558:0:10093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790849.329562:0:10093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790849.329568:0:10093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.329575:0:10093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4600/0xcf9477fddcf1ea9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790849.329693:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+32:12491:x1874634250234240:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 866us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790849.329726:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 254 00000100:00100000:3.0:1787790849.421287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790849.421347:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234368 00000100:00100000:0.0:1787790849.421360:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234368 00000100:00080000:1.0:1787790849.421442:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790849.421520:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 79 00000100:00100000:0.0:1787790849.421532:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+7:2401:x1874634250234368:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:0.0:1787790849.421554:0:10092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790849.421575:0:10092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057f1574c/0xcf9477fddcf1eaa4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f41 expref: -99 pid: 10092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787790849.421601:0:10092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f85fe, atime: 0x6a8f85fe, ctime: 0x6a8f85fe, blocks: 0x8 00010000:00010000:0.0:1787790849.421623:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1787790849.421627:0:10092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790849.421635:0:10092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057f1574c/0xcf9477fddcf1eaa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f41 expref: 8 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.421652:0:10092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057f1574c/0xcf9477fddcf1eaa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f41 expref: 8 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790849.421665:0:10092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4600, rc 0) 00000100:00100000:0.0:1787790849.421764:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a61a333f-852a-40de-8207-4f7de209a9a4+8:2401:x1874634250234368:12345-192.168.202.22@tcp:101:cat.0 Request processed in 234us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790849.421772:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 79 00000100:00100000:1.0:1787790849.424366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790849.424469:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234496 00000100:00100000:0.0:1787790849.424495:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234496 00002000:00100000:0.0:1787790849.424547:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff916fc45b1680 x1874634250234496/t0(0) o3->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:690/0 lens 488/0 e 0 to 0 dl 1787790860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787790849.424557:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc45b1680 with x1874634250234496 ext(0->4095) 00002000:00010000:0.0:1787790849.424561:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc45b1680 00000100:00100000:0.0:1787790849.424592:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:0.0:1787790849.424602:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2400:x1874634250234496:12345-192.168.202.22@tcp:3:cat.0 00000100:00100000:2.0:1787790849.425029:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a61a333f-852a-40de-8207-4f7de209a9a4+8:2400:x1874634250234496:12345-192.168.202.22@tcp:3:cat.0 Request processed in 425us (675us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787790849.425174:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00002000:00100000:2.0:1787790849.425183:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff916fc45b1680 x1874634250234496/t0(0) o3->a61a333f-852a-40de-8207-4f7de209a9a4@192.168.202.22@tcp:690/0 lens 488/4536 e 0 to 0 dl 1787790860 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787790849.425193:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff916fc45b1680 with x1874634250234496 ext(0->4095) 00002000:00010000:2.0:1787790849.425198:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916fc45b1680 00000100:00100000:1.0:1787790849.867208:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787790849.867219:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790849.867254:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268099200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790849.867409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790849.868399:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099200 00000100:00100000:2.0:1787790849.868431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099200 00000100:00100000:2.0:1787790849.868513:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787790849.868525:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268099200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790849.868573:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787790849.868674:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268099200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790849.868682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787790849.869208:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268099200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790849.875173:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268099328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790849.875292:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790849.875439:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099328 00000100:00100000:3.0:1787790849.875450:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099328 00000100:00100000:3.0:1787790849.875517:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787790849.875528:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268099328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790849.875576:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787790849.875647:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268099328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790849.875655:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787790849.876228:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268099328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787790850.893141:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790851.403050:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790851.403074:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268099456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790851.403158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403228:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268099840:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403281:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268100352:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403319:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268100864:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403354:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787790851.403359:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268099968:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.403377:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268099584:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403393:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268100480:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.403411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403431:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268100992:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.403431:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268100096:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.403449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.403463:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268100608:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099840 00000100:00100000:1.0:1787790851.403478:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099840 00000100:00100000:0.0:1787790851.403482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.403496:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787790851.403501:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268099712:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099968 00000100:00100000:1.0:1787790851.403517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099968 00000100:00100000:0.0:1787790851.403520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787790851.403534:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268100224:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403540:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268099840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.403552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790851.403581:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268100736:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268099840:12345-0@lo:400:kworker.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.403600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790851.403604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787790851.403620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787790851.403621:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100352 00000100:00100000:0.0:1787790851.403624:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100352 00000100:00100000:1.0:1787790851.403626:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268099968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.403654:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100864 00000100:00100000:1.0:1787790851.403656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268099968:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.403656:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100864 00000100:00100000:1.0:1787790851.403662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787790851.403669:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100096 00000100:00100000:1.0:1787790851.403677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099712 00000100:00100000:0.0:1787790851.403677:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100096 00000100:00100000:1.0:1787790851.403679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099712 00000100:00100000:1.0:1787790851.403691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100224 00000100:00100000:1.0:1787790851.403693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100224 00000100:00100000:0.0:1787790851.403720:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100736 00000100:00100000:0.0:1787790851.403723:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100736 00000100:00100000:1.0:1787790851.403729:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787790851.403735:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268100352:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790851.403770:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787790851.403782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787790851.403788:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403812:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268100864:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.403813:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787790851.403817:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787790851.403819:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.403827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787790851.403832:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268100096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.403851:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268099712:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790851.403852:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268100096:12345-0@lo:400:kworker.0 Request processed in 21us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790851.403857:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787790851.403915:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099456 00000100:00100000:2.0:1787790851.403919:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099456 00000100:00100000:2.0:1787790851.403949:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787790851.403956:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268099456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790851.403977:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787790851.404013:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874634268099456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790851.404019:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787790851.404217:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790851.407320:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268101120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790851.407433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790851.407533:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101120 00000100:00100000:3.0:1787790851.407543:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101120 00000100:00100000:3.0:1787790851.407624:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787790851.407634:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268101120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790851.407666:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787790851.407737:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268101120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.407745:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787790851.408158:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268101120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790851.408223:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100480 00000100:00100000:3.0:1787790851.408228:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100480 00000100:00100000:3.0:1787790851.408272:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100992 00000100:00100000:3.0:1787790851.408275:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100992 00000100:00100000:3.0:1787790851.408287:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268100608 00000100:00100000:3.0:1787790851.408290:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268100608 00000100:00100000:3.0:1787790851.408306:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787790851.408314:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268100480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.408362:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268100480:12345-0@lo:400:kworker.0 Request processed in 48us (4943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.408368:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787790851.408380:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790851.408386:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268100992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.408414:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268100992:12345-0@lo:400:kworker.0 Request processed in 28us (4965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.408421:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787790851.408449:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787790851.408455:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.408488:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268100608:12345-0@lo:400:kworker.0 Request processed in 33us (5004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.408494:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787790851.408528:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268099584 00000100:00100000:3.0:1787790851.408532:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268099584 00000100:00100000:1.0:1787790851.408555:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787790851.408570:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787790851.408578:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268099584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.408617:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268099584:12345-0@lo:400:kworker.0 Request processed in 41us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.408624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787790851.408630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787790851.408651:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268100224:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787790851.408754:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790851.408761:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790851.408764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790851.408768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790851.408790:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787790851.408804:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.408861:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268100736:12345-0@lo:400:kworker.0 Request processed in 59us (5257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790851.408869:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787790851.408899:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268099712:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.408922:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268100224:0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.408945:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268099968:0@lo:400:kworker.0 00000100:00100000:1.0:1787790851.412152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268100224:12345-0@lo:400:kworker.0 Request processed in 3503us (8589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790851.412167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787790851.417091:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268100480:0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.417132:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268100992:0@lo:400:kworker.0 00010000:00080000:3.0:1787790851.417150:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe88b40 x1874634268100864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790851.417193:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268100864:0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.417213:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268099840:0@lo:400:kworker.0 00010000:00080000:3.0:1787790851.417227:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d61c0 x1874634268100352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790851.417235:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268100352:0@lo:400:kworker.0 00000100:00100000:3.0:1787790851.417265:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268099456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790851.423951:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268100736:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.423984:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268099584:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.423999:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268100096:0@lo:400:kworker.0 00000100:00100000:0.0:1787790851.424012:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268100608:0@lo:400:kworker.0 00010000:00010000:2.0:1787790851.915764:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787790851.921721:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00080000:1.0:1787790851.921779:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1787790851.921792:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:2.0:1787790851.922330:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170c34b5000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787790851.922339:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170fc11ef00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170c34b5240 00000020:00080000:2.0:1787790851.922343:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170fc11e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff916fc3461400 00000020:00080000:3.0:1787790851.922383:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1787790851.922464:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787790851.922506:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1787790851.922535:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.922559:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.922567:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.922574:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790851.922580:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.922589:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.922611:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9170e15d8e00) 00010000:00010000:2.0:1787790851.922613:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790851.922620:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790851.922626:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1ea1f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790852.556495:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556535:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556559:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556578:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556593:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556622:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556646:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790852.556678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234880 00000100:00100000:1.0:1787790852.556690:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234880 00000100:00100000:1.0:1787790852.556783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235392 00000100:00100000:1.0:1787790852.556787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235392 00000100:00100000:1.0:1787790852.556800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234752 00000100:00100000:1.0:1787790852.556803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234752 00000100:00100000:1.0:1787790852.556815:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235264 00000100:00100000:1.0:1787790852.556817:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235264 00000100:00100000:1.0:1787790852.556836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 319 00000100:00100000:1.0:1787790852.556846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250234880:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790852.557206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250234624 00000100:00100000:3.0:1787790852.557211:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250234624 00000100:00100000:3.0:1787790852.557250:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 389 00000100:00100000:3.0:1787790852.557258:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250234624:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790852.560302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 320 00000100:00100000:2.0:1787790852.560334:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250235392:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790852.562875:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2403:x1874634250234624:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 5597us (6371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790852.562895:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 389 00000100:00100000:3.0:1787790852.562980:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 321 00000100:00100000:3.0:1787790852.562998:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+18:2403:x1874634250234752:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790852.563057:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+18:2403:x1874634250234752:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 68us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790852.563077:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 321 00000100:00100000:3.0:1787790852.563112:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 322 00000100:00100000:3.0:1787790852.563121:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250235264:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790852.563162:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250235264:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 42us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790852.563169:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 322 00000100:00100000:3.0:1787790852.563196:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235136 00000100:00100000:3.0:1787790852.563205:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235136 00000100:00100000:3.0:1787790852.563258:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235008 00000100:00100000:3.0:1787790852.563262:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235008 00000100:00100000:3.0:1787790852.563594:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:3.0:1787790852.563607:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250235136:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790852.563645:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2403:x1874634250235136:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 42us (7085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790852.563653:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:3.0:1787790852.563667:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:3.0:1787790852.563674:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250235008:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790852.563700:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250235008:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (7078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790852.563736:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00080000:3.0:1787790852.563767:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790852.563772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790852.563775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790852.563779:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790852.575028:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2403:x1874634250234880:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 18162us (18470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790852.575050:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 319 00000100:00100000:2.0:1787790852.578334:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2403:x1874634250235392:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 17991us (21731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790852.578357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 320 00010000:00010000:2.0:1787790852.940374:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790853.963046:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268101376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790853.963103:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268101248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790853.963153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790853.963242:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101376 00000100:00100000:1.0:1787790853.963249:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101376 00000100:00100000:1.0:1787790853.963301:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787790853.963310:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268101376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790853.963339:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790853.965973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790853.966103:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790853.967346:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101248 00000100:00100000:2.0:1787790853.967366:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101248 00000100:00100000:2.0:1787790853.967454:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787790853.967468:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268101248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787790853.967506:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787790853.967612:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268101248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790853.967620:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787790853.967725:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268101248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790853.968574:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268101376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5250us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790853.968594:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1787790853.968672:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790853.968797:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268101376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790854.214957:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790854.215890:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235520 00000100:00100000:3.0:1787790854.215910:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235520 00000100:00100000:3.0:1787790854.216027:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 255 00000100:00100000:3.0:1787790854.216046:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+18:12145:x1874634250235520:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1787790854.216065:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790854.216226:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a61a333f-852a-40de-8207-4f7de209a9a4+18:12145:x1874634250235520:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 185us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790854.216254:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 255 00000100:00100000:3.0:1787790854.230013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790854.230451:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235648 00000100:00100000:1.0:1787790854.230467:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235648 00000100:00080000:3.0:1787790854.230561:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790854.230575:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 256 00000100:00100000:1.0:1787790854.230590:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:12145:x1874634250235648:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787790854.230765:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61a333f-852a-40de-8207-4f7de209a9a4+5:12145:x1874634250235648:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 179us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790854.230774:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 256 00000100:00100000:0.0:1787790854.244673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790854.245038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250235904 00000100:00100000:2.0:1787790854.245053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250235904 00000100:00100000:2.0:1787790854.245150:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:2.0:1787790854.245163:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+18:12145:x1874634250235904:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787790854.245502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+19:12145:x1874634250235904:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 340us (855us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787790854.245512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:3.0:1787790854.524260:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790854.524409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236032 00000100:00100000:2.0:1787790854.524510:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236032 00000100:00080000:3.0:1787790854.524617:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790854.524645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 257 00000100:00100000:2.0:1787790854.524658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:12948:x1874634250236032:12345-192.168.202.22@tcp:101:lsof.0 00010000:00010000:2.0:1787790854.524799:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790854.524829:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1eaab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f48 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790854.525181:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1eab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790854.525201:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790854.525220:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790854.525800:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790854.525807:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790854.525841:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790854.526368:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1eaab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f48 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790854.526398:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1eab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f48 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790854.526409:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:2.0:1787790854.526412:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790854.526783:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995600, rc 0) 00000100:00100000:2.0:1787790854.527351:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:12948:x1874634250236032:12345-192.168.202.22@tcp:101:lsof.0 Request processed in 2691us (3098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790854.527363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 257 00010000:00010000:0.0:1787790854.987104:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790854.987414:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268101504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790854.987516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790854.987575:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790854.987599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268101632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790854.987847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790854.988351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101504 00000100:00100000:3.0:1787790854.988365:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101504 00000100:00100000:2.0:1787790854.988506:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101632 00000100:00100000:2.0:1787790854.988512:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101632 00000100:00100000:2.0:1787790854.988587:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787790854.988598:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c7f65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268101504:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790854.988628:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787790854.988639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268101632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790854.988644:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:3.0:1787790854.988662:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787790854.988740:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268101632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790854.988750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787790854.988751:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c7f65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268101504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790854.988760:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787790854.988808:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268101632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790854.989441:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268101504:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787790856.010889:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790856.523211:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268101888:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.523300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.523377:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268102400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.523406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.523429:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268102912:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.523447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.523477:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787790856.523483:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268102016:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.523507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.523526:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268102528:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.523544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.523558:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268103040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.523575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.523618:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101888 00000100:00100000:2.0:1787790856.523626:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101888 00000100:00100000:2.0:1787790856.523665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102400 00000100:00100000:2.0:1787790856.523668:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102400 00000100:00100000:2.0:1787790856.523749:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102912 00000100:00100000:2.0:1787790856.523753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102912 00000100:00100000:2.0:1787790856.523771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102528 00000100:00100000:2.0:1787790856.523774:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102528 00000100:00100000:2.0:1787790856.523786:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103040 00000100:00100000:2.0:1787790856.523788:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103040 00000100:00100000:2.0:1787790856.523804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787790856.523813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268101888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524153:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268101888:12345-0@lo:400:kworker.0 Request processed in 339us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790856.524161:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787790856.524185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787790856.524192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268102400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524220:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268102400:12345-0@lo:400:kworker.0 Request processed in 29us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790856.524225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787790856.524236:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787790856.524242:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268102912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524267:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268102912:12345-0@lo:400:kworker.0 Request processed in 26us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790856.524272:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787790856.524282:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787790856.524287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268102528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524310:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268102528:12345-0@lo:400:kworker.0 Request processed in 23us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790856.524315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787790856.524326:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787790856.524339:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524366:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268103040:12345-0@lo:400:kworker.0 Request processed in 28us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790856.524372:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00080000:2.0:1787790856.524412:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe89680 x1874634268102528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790856.524426:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268102528:0@lo:400:kworker.0 00010000:00080000:2.0:1787790856.524435:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4595680 x1874634268103040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790856.524444:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268103040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524454:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268101888:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524462:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268102400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.524470:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268102912:0@lo:400:kworker.0 00000100:00080000:3.0:1787790856.524648:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790856.524653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790856.524665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102016 00000100:00100000:3.0:1787790856.524669:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102016 00000100:00100000:3.0:1787790856.524702:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787790856.524736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268102016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.524774:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268102016:12345-0@lo:400:kworker.0 Request processed in 40us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.524779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787790856.524800:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268101760:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.524834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.524876:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268102272:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.524909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.524928:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268102784:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.524950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.524967:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268103296:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.525019:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787790856.525026:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268102144:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.525096:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268102656:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.525132:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268103168:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790856.525175:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102784 00000100:00100000:3.0:1787790856.525179:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102784 00000100:00100000:3.0:1787790856.525204:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103296 00000100:00100000:3.0:1787790856.525207:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103296 00000100:00100000:3.0:1787790856.525219:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102656 00000100:00100000:3.0:1787790856.525221:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102656 00000100:00100000:3.0:1787790856.525232:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103168 00000100:00100000:3.0:1787790856.525233:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103168 00000100:00100000:3.0:1787790856.525246:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787790856.525251:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268102784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525287:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268102784:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.525292:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787790856.525305:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787790856.525310:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268103296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525347:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268103296:12345-0@lo:400:kworker.0 Request processed in 37us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.525353:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787790856.525363:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787790856.525369:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268102656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525390:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268102656:12345-0@lo:400:kworker.0 Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.525395:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787790856.525405:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787790856.525412:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525435:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268103168:12345-0@lo:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.525441:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787790856.525466:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102144 00000100:00100000:3.0:1787790856.525469:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102144 00000100:00100000:3.0:1787790856.525489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787790856.525494:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268102144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268102144:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.525528:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1787790856.525541:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790856.525544:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790856.525553:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268102272 00000100:00100000:3.0:1787790856.525556:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268102272 00000100:00100000:3.0:1787790856.525576:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787790856.525582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268102272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268102272:12345-0@lo:400:kworker.0 Request processed in 38us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790856.525626:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787790856.525663:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268102144:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525673:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268102656:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525683:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268103168:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525691:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268102272:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525700:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268102784:0@lo:400:kworker.0 00000100:00100000:3.0:1787790856.525736:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787790856.525742:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff916fc4546580, transno 4294967323 00000004:00080000:3.0:1787790856.525751:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787790856.525769:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268103296:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.526329:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268103424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790856.526376:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790856.526418:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268102016:0@lo:400:kworker.0 00000100:00100000:2.0:1787790856.526434:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790856.526439:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268103552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790856.526459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790856.526597:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268101760 00000100:00100000:1.0:1787790856.526602:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268101760 00000100:00100000:1.0:1787790856.526641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787790856.526649:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268101760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790856.526696:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268101760:12345-0@lo:400:kworker.0 Request processed in 47us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790856.526741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787790856.526882:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103424 00000100:00100000:1.0:1787790856.526886:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103424 00000100:00100000:1.0:1787790856.526911:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103552 00000100:00100000:1.0:1787790856.526914:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103552 00000100:00100000:1.0:1787790856.526926:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787790856.526932:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268103424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787790856.526952:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787790856.527007:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268103424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790856.527013:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787790856.527027:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787790856.527033:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268103552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790856.527043:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787790856.527077:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268103552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790856.527084:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787790856.527254:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268103552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790856.527267:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268103424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790856.527295:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268101760:0@lo:400:kworker.0 00010000:00010000:2.0:1787790857.035635:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790857.674408:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674448:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674472:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674493:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674523:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674582:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790857.674629:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236160 00000100:00100000:1.0:1787790857.674639:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236160 00000100:00100000:1.0:1787790857.674693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 391 00000100:00100000:1.0:1787790857.674721:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250236160:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.674793:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170d6022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2402:x1874634250236160:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.674801:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 391 00000100:00100000:1.0:1787790857.674835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236416 00000100:00100000:1.0:1787790857.674839:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236416 00000100:00100000:1.0:1787790857.674875:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236928 00000100:00100000:1.0:1787790857.674878:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236928 00000100:00100000:1.0:1787790857.674891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236288 00000100:00100000:1.0:1787790857.674893:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236288 00000100:00100000:1.0:1787790857.674904:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236800 00000100:00100000:1.0:1787790857.674907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236800 00000100:00100000:1.0:1787790857.674920:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 329 00000100:00100000:1.0:1787790857.674925:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250236416:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.674956:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250236416:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.674963:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 329 00000100:00100000:1.0:1787790857.674976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 330 00000100:00100000:1.0:1787790857.674982:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250236928:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.675006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2402:x1874634250236928:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.675013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 330 00000100:00100000:1.0:1787790857.675036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 331 00000100:00100000:1.0:1787790857.675055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:2402:x1874634250236288:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.675090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:2402:x1874634250236288:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 48us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.675096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 331 00000100:00100000:1.0:1787790857.675108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 332 00000100:00100000:1.0:1787790857.675114:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2402:x1874634250236800:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.675136:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2402:x1874634250236800:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.675142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 332 00000100:00100000:1.0:1787790857.675161:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236672 00000100:00100000:1.0:1787790857.675164:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236672 00000100:00100000:1.0:1787790857.675190:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250236544 00000100:00100000:1.0:1787790857.675193:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250236544 00000100:00100000:1.0:1787790857.675214:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:1.0:1787790857.675221:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250236672:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.675251:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2402:x1874634250236672:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.675258:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:1.0:1787790857.675269:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:1.0:1787790857.675274:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250236544:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790857.675296:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2402:x1874634250236544:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 22us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790857.675302:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00080000:1.0:1787790857.675479:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787790857.675483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790857.675486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790857.675488:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1787790857.844003:0:14947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:34:17 (1787790857) 00010000:00010000:0.0:1787790858.068479:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787790858.075920:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787790858.075934:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787790858.075956:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787790858.075983:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787790858.382932:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787790858.570867:0:13789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787790858.570878:0:13789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790858.570997:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787790858.571004:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787790859.083466:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790859.083489:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268103680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790859.083599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790859.083681:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103680 00000100:00100000:1.0:1787790859.083690:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103680 00000100:00100000:1.0:1787790859.083775:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787790859.083786:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268103680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790859.083820:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790859.083874:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268103680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790859.083881:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1787790859.083906:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790859.083945:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268103680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787790859.084670:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790859.084881:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268103808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790859.084925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790859.084972:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103808 00000100:00100000:1.0:1787790859.084978:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103808 00000100:00100000:1.0:1787790859.085017:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787790859.085025:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268103808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787790859.085052:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787790859.085118:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268103808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790859.085126:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787790859.085147:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790859.085175:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268103808:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787790860.106922:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790860.113149:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268103936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790860.113343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790860.113597:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268104064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790860.113644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790860.120109:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268103936 00000100:00100000:3.0:1787790860.120125:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268103936 00000100:00100000:0.0:1787790860.120476:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104064 00000100:00100000:0.0:1787790860.120481:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104064 00000100:00100000:0.0:1787790860.120505:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787790860.120516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268103936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790860.120560:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790860.120674:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268103936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (7332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790860.120682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787790860.120699:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787790860.120731:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268104064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790860.120748:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787790860.120787:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268104064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (7143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790860.120793:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787790860.120919:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268104064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790860.121067:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268103936:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787790861.131348:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790861.420266:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790861.420369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250237184 00000100:00100000:2.0:1787790861.420380:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250237184 00000100:00080000:1.0:1787790861.420515:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790861.420577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:2.0:1787790861.420591:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+18:13171:x1874634250237184:12345-192.168.202.22@tcp:35:umount.0 00000100:00100000:2.0:1787790861.421090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61a333f-852a-40de-8207-4f7de209a9a4+19:13171:x1874634250237184:12345-192.168.202.22@tcp:35:umount.0 Request processed in 502us (837us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787790861.421096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:1.0:1787790861.431598:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790861.431926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250237440 00000100:00100000:2.0:1787790861.431936:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250237440 00000100:00100000:2.0:1787790861.431998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:2.0:1787790861.432021:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+19:13171:x1874634250237440:12345-192.168.202.22@tcp:35:umount.0 00000100:00100000:2.0:1787790861.432325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+20:13171:x1874634250237440:12345-192.168.202.22@tcp:35:umount.0 Request processed in 317us (736us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787790861.432334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:1.0:1787790861.441584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790861.441745:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250237696 00000100:00100000:2.0:1787790861.441755:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250237696 00000100:00100000:2.0:1787790861.441822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:2.0:1787790861.441831:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ed866450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+20:13171:x1874634250237696:12345-192.168.202.22@tcp:35:umount.0 00000100:00100000:2.0:1787790861.442091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ed866450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:13171:x1874634250237696:12345-192.168.202.22@tcp:35:umount.0 Request processed in 259us (1401us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787790861.442099:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:3.0:1787790861.449758:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790861.449850:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250237952 00000100:00100000:2.0:1787790861.449876:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250237952 00000100:00100000:2.0:1787790861.449935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:2.0:1787790861.449946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+21:13171:x1874634250237952:12345-192.168.202.22@tcp:35:umount.0 00000100:00100000:2.0:1787790861.450296:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61a333f-852a-40de-8207-4f7de209a9a4+22:13171:x1874634250237952:12345-192.168.202.22@tcp:35:umount.0 Request processed in 351us (548us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787790861.450305:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:0.0:1787790861.457840:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790861.458240:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790861.458378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790861.458445:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250238208 00000100:00100000:1.0:1787790861.458455:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250238208 00000100:00100000:1.0:1787790861.458523:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250238720 00000100:00100000:1.0:1787790861.458527:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250238720 00000100:00100000:1.0:1787790861.458556:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:1.0:1787790861.458566:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56437f26-ebd6-4232-a9cd-72d1b9652a36+14:2401:x1874634250238208:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790861.458582:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790861.458603:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39c00/0xcf9477fddcf1da89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a9b expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790861.458621:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790861.458673:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56437f26-ebd6-4232-a9cd-72d1b9652a36+13:2401:x1874634250238208:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 108us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790861.458681:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:1.0:1787790861.458701:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:1.0:1787790861.458750:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:2401:x1874634250238720:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790861.458773:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790861.458784:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1dca4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b74 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790861.458793:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790861.458812:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:2401:x1874634250238720:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 64us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790861.458819:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:0.0:1787790861.461439:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790861.461519:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250238464 00000100:00100000:1.0:1787790861.461529:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250238464 00000100:00100000:1.0:1787790861.461587:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:1.0:1787790861.461596:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:2401:x1874634250238464:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790861.461610:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790861.461627:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9f400/0xcf9477fddcf1d9cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223a5c expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790861.461644:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790861.461693:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2401:x1874634250238464:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 97us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790861.461701:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787790861.462634:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250238592 00000100:00100000:3.0:1787790861.462644:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250238592 00000100:00100000:3.0:1787790861.462739:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 80 00000100:00100000:3.0:1787790861.462748:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+7:2399:x1874634250238592:12345-192.168.202.22@tcp:9:umount.0 00000020:00000080:3.0:1787790861.462774:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1e01d 00000020:00010000:3.0:1787790861.462782:0:8428:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9170c355d000: total 0 00000100:00080000:3.0:1787790861.462786:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9170c355d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790861.462831:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1787790861.463135:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9170c355d000: total 0 00010000:00010000:0.0:1787790861.463185:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9170c355d000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787790861.463234:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057f1574c/0xcf9477fddcf1eaa4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f41 expref: 6 pid: 10092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.463267:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1e3d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d5e expref: 5 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.463297:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9170c355d000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787790861.463310:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790861.463312:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790861.463313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790861.464728:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61a333f-852a-40de-8207-4f7de209a9a4+2:2399:x1874634250238592:12345-192.168.202.22@tcp:9:umount.0 Request processed in 1974us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790861.464751:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 80 00000100:00080000:1.0:1787790861.465104:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790861.470518:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790861.470603:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250238848 00000100:00100000:1.0:1787790861.470613:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250238848 00000100:00100000:1.0:1787790861.470691:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 81 00000100:00100000:1.0:1787790861.470702:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+5:2399:x1874634250238848:12345-192.168.202.22@tcp:9:umount.0 00000020:00000080:1.0:1787790861.470768:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1dda7 00000100:00080000:1.0:1787790861.470777:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9170c4cce000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790861.470846:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1787790861.471311:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787790861.471456:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790861.471653:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61a333f-852a-40de-8207-4f7de209a9a4+2:2399:x1874634250238848:12345-192.168.202.22@tcp:9:umount.0 Request processed in 951us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790861.471663:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 81 00000100:00100000:0.0:1787790861.488047:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790861.488631:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250239872 00000100:00100000:1.0:1787790861.488641:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250239872 00000100:00100000:1.0:1787790861.488804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 258 00000100:00100000:1.0:1787790861.488816:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+22:2399:x1874634250239872:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:1.0:1787790861.488893:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d9da 00000020:00010000:1.0:1787790861.488911:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff916fc1c8e000: total 0 00000100:00080000:1.0:1787790861.488917:0:6512:0:(import.c:65:import_set_state_nolock()) ffff916fc1c8f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790861.488939:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1787790861.489140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61a333f-852a-40de-8207-4f7de209a9a4+21:2399:x1874634250239872:12345-192.168.202.22@tcp:39:umount.0 Request processed in 326us (1105us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1787790861.490059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 258 00000020:00010000:0.0:1787790861.490383:0:9514:0:(genops.c:1907:obd_stale_export_get()) Get export ffff916fc1c8e000: total 0 00010000:00010000:0.0:1787790861.490439:0:9514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff916fc1c8e000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787790861.490508:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790861.490513:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790861.490522:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad5400/0xcf9477fddcf1e078 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223c77 expref: 20 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490543:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc3700300) 00010000:00010000:0.0:1787790861.490546:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787790861.490549:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995800/0xcf9477fddcf1dd22 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b89 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490566:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790861.490569:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790861.490573:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa400/0xcf9477fddcf1e396 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d49 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490585:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790861.490588:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790861.490606:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994a00/0xcf9477fddcf1e985 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ef4 expref: 17 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490622:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790861.490624:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787790861.490628:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd39000/0xcf9477fddcf1e3c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d57 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490641:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e15d8800) 00010000:00010000:0.0:1787790861.490643:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790861.490647:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4400/0xcf9477fddcf1dd06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b82 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490664:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790861.490667:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787790861.490671:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4a00/0xcf9477fddcf1e45a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d81 expref: 14 pid: 10093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490683:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790861.490686:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787790861.490690:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994000/0xcf9477fddcf1ea65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f2c expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490702:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9170e15d8500) 00010000:00010000:0.0:1787790861.490737:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787790861.490742:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1e2b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d11 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490758:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9170e15d8000) 00010000:00010000:0.0:1787790861.490766:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787790861.490771:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1ea8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f3a expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490787:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9170e15d8a00) 00010000:00010000:0.0:1787790861.490789:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787790861.490793:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3ad4c00/0xcf9477fddcf1dd7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b9e expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490806:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff916fc2690f00) 00010000:00010000:0.0:1787790861.490809:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787790861.490812:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1e747 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223e5a expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490826:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:0.0:1787790861.490828:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790861.490832:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fac00/0xcf9477fddcf1e43e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223d7a expref: 8 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790861.490843:0:9514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff916fc1c8e000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787790861.491477:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790861.491481:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790861.491483:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790861.501314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790861.501608:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240000 00000100:00100000:1.0:1787790861.501617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240000 00000100:00100000:1.0:1787790861.501692:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 259 00000100:00080000:2.0:1787790861.501793:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790861.501924:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+5:2399:x1874634250240000:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:1.0:1787790861.501983:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d9e1 00000100:00080000:1.0:1787790861.502000:0:6514:0:(import.c:65:import_set_state_nolock()) ffff916fc1c88000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790861.502040:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787790861.502249:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61a333f-852a-40de-8207-4f7de209a9a4+3:2399:x1874634250240000:12345-192.168.202.22@tcp:39:umount.0 Request processed in 547us (941us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787790861.502257:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 259 00010000:00010000:0.0:1787790861.502471:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790861.643355:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790861.643378:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268104192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790861.643483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790861.644109:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104192 00000100:00100000:2.0:1787790861.644119:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104192 00000100:00100000:2.0:1787790861.644201:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787790861.644213:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268104192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787790861.644246:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787790861.644306:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268104192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790861.644314:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1787790861.644347:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787790861.644390:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268104192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787790861.644411:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268104320:0@lo:400:kworker.0 00000100:00100000:2.0:1787790861.644458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.644458:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268104704:0@lo:400:kworker.0 00000100:00100000:2.0:1787790861.644486:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268104832:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.644489:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.644507:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268105216:0@lo:400:kworker.0 00000100:00100000:2.0:1787790861.644508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790861.644523:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268105344:0@lo:400:kworker.0 00000100:00100000:2.0:1787790861.644543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.644549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104704 00000100:00100000:0.0:1787790861.644552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104704 00000100:00100000:2.0:1787790861.644572:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104320 00000100:00100000:2.0:1787790861.644575:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104320 00000100:00100000:0.0:1787790861.644579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787790861.644585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268104704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790861.644607:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787790861.644613:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.644620:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268104704:12345-0@lo:400:kworker.0 Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.644626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787790861.644642:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a75db525-924f-489b-b982-1d04f64567fb+24:3639:x1874634268104320:12345-0@lo:400:kworker.0 Request processed in 30us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.644642:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105344 00000100:00100000:0.0:1787790861.644645:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105344 00000100:00100000:2.0:1787790861.644648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787790861.644673:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787790861.644680:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.645229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104832 00000100:00100000:3.0:1787790861.645235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104832 00000100:00100000:3.0:1787790861.645269:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787790861.645277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268104832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790861.645385:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268104448:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.654553:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268105344:12345-0@lo:400:kworker.0 Request processed in 9862us (9997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.654570:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1787790861.654619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790861.654637:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.654691:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268105728:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.654749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.654803:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268104704:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.654820:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790861.654826:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268105856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790861.654852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.654892:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105856 00000100:00100000:0.0:1787790861.654898:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105856 00000100:00100000:0.0:1787790861.654947:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787790861.654956:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268105856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790861.654994:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787790861.655050:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268105856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.655057:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1787790861.655071:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790861.655100:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268105856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790861.655132:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268104576:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.655160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.655182:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268105088:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.655205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.655599:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268105600:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.655629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790861.655654:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105088 00000100:00100000:0.0:1787790861.655658:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105088 00000100:00100000:0.0:1787790861.655700:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105600 00000100:00100000:0.0:1787790861.655722:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105600 00000100:00100000:0.0:1787790861.655742:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787790861.655748:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.655785:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268105088:12345-0@lo:400:kworker.0 Request processed in 36us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.655791:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787790861.655803:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787790861.658327:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105216 00000100:00100000:3.0:1787790861.658351:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105216 00000100:00100000:3.0:1787790861.658415:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105728 00000100:00100000:3.0:1787790861.658418:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105728 00000100:00100000:3.0:1787790861.658454:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790861.658463:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.658546:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268105216:12345-0@lo:400:kworker.0 Request processed in 84us (3908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790861.658553:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787790861.658568:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787790861.658574:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268105728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.658600:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268105728:12345-0@lo:400:kworker.0 Request processed in 27us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790861.658606:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787790861.658672:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268105216:0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.658694:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268105728:0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.659053:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268104832:12345-0@lo:400:kworker.0 Request processed in 13775us (14541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790861.659061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787790861.659074:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268105600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.659115:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268104832:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.659115:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268105600:12345-0@lo:400:kworker.0 Request processed in 3307us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.659135:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787790861.659145:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268105344:0@lo:400:kworker.0 00000100:00080000:0.0:1787790861.659155:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790861.659159:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790861.659169:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268104320:0@lo:400:kworker.0 00010000:00080000:0.0:1787790861.659192:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc44603c0 x1874634268105600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790861.659201:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104576 00000100:00100000:3.0:1787790861.659204:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104576 00000100:00100000:0.0:1787790861.659204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268105600:0@lo:400:kworker.0 00010000:00080000:0.0:1787790861.659231:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4595e00 x1874634268105088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790861.659236:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787790861.659240:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268105088:0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.659242:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.659279:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268104576:12345-0@lo:400:kworker.0 Request processed in 37us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790861.659285:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787790861.659290:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268104576:0@lo:400:kworker.0 00000100:00100000:1.0:1787790861.662505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790861.662623:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268104960:0@lo:400:kworker.0 00000100:00100000:1.0:1787790861.665066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790861.671636:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268105472:0@lo:400:kworker.0 00000100:00100000:1.0:1787790861.671773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790861.671806:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104448 00000100:00100000:3.0:1787790861.671814:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104448 00000100:00100000:3.0:1787790861.671873:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268104960 00000100:00100000:3.0:1787790861.671877:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268104960 00000100:00100000:3.0:1787790861.671915:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787790861.671925:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268104448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790861.671982:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268104448:12345-0@lo:400:kworker.0 Request processed in 59us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790861.671989:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787790861.671996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787790861.672017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268104960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787790861.672022:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790861.672054:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268104960:12345-0@lo:400:kworker.0 Request processed in 51us (6993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790861.672061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787790861.672368:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268104448:0@lo:400:kworker.0 00000100:00100000:1.0:1787790861.672380:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268104960:0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.672497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105472 00000100:00100000:0.0:1787790861.672502:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105472 00000100:00100000:0.0:1787790861.672596:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787790861.672604:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790861.672653:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268105472:12345-0@lo:400:kworker.0 Request processed in 51us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790861.672660:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787790861.672767:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268105472:0@lo:400:kworker.0 00000100:00080000:3.0:1787790861.672864:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787790862.155302:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790862.788198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790862.788244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790862.788287:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790862.788336:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240384 00000100:00100000:2.0:1787790862.788347:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240384 00000100:00100000:2.0:1787790862.788410:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240256 00000100:00100000:2.0:1787790862.788413:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240256 00000100:00100000:2.0:1787790862.788438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 339 00000100:00100000:2.0:1787790862.788464:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250240384:12345-192.168.202.22@tcp:400:kworker.0 00000100:00080000:3.0:1787790862.788491:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790862.788497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787790862.788546:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2400:x1874634250240384:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790862.788554:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 339 00000100:00100000:2.0:1787790862.788576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 340 00000100:00100000:2.0:1787790862.788583:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2400:x1874634250240256:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790862.788610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2400:x1874634250240256:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790862.788617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 340 00000100:00100000:1.0:1787790862.789053:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240128 00000100:00100000:1.0:1787790862.789058:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240128 00000100:00100000:1.0:1787790862.789148:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 393 00000100:00100000:1.0:1787790862.789155:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2400:x1874634250240128:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790862.789188:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2400:x1874634250240128:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 34us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790862.789195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 393 00010000:00010000:0.0:1787790863.179039:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790863.357233:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790863.357285:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790863.357342:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790863.357626:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240512 00000100:00100000:0.0:1787790863.357653:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240512 00000100:00100000:0.0:1787790863.357748:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240768 00000100:00100000:0.0:1787790863.357752:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240768 00000100:00100000:0.0:1787790863.357769:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250240640 00000100:00100000:0.0:1787790863.357772:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250240640 00000100:00100000:0.0:1787790863.357790:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:0.0:1787790863.358004:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+12:2403:x1874634250240512:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790863.358023:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790863.358044:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c165ec00/0xcf9477fddcf1dadd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ab0 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790863.358064:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790863.358121:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+11:2403:x1874634250240512:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 133us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790863.358130:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:0.0:1787790863.358148:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:0.0:1787790863.358155:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+10:2403:x1874634250240768:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790863.358162:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790863.358172:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1dc9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223b6d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790863.358182:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790863.358199:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+9:2403:x1874634250240768:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 45us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790863.358206:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:0.0:1787790863.358295:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787790863.358302:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+8:2403:x1874634250240640:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790863.358309:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790863.358319:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c165fe00/0xcf9477fddcf1dae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223ae1 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790863.358330:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790863.358356:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56437f26-ebd6-4232-a9cd-72d1b9652a36+7:2403:x1874634250240640:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 55us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790863.358363:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:3.0:1787790863.361314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790863.361405:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241024 00000100:00100000:2.0:1787790863.361427:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241024 00000100:00100000:2.0:1787790863.361486:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 260 00000100:00100000:2.0:1787790863.361498:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+6:2399:x1874634250241024:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:2.0:1787790863.361546:0:10093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1daf2 00000020:00010000:2.0:1787790863.361557:0:10093:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9170f6791800: total 0 00000100:00080000:2.0:1787790863.361562:0:10093:0:(import.c:65:import_set_state_nolock()) ffff9170f6792000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787790863.362032:0:10093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1787790863.362212:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2399:x1874634250241024:12345-192.168.202.22@tcp:39:umount.0 Request processed in 715us (906us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787790863.362221:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 260 00000020:00010000:1.0:1787790863.367828:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9170f6791800: total 0 00010000:00010000:1.0:1787790863.367838:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790863.367915:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9170f6791800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787790863.367965:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2690c00) 00010000:00010000:1.0:1787790863.367970:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790863.367983:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1eab2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f48 expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790863.368037:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9170f6791800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787790863.368055:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790863.368057:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790863.368058:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790863.379387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790863.382107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241152 00000100:00100000:1.0:1787790863.382124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241152 00000100:00100000:1.0:1787790863.382205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 261 00000100:00100000:1.0:1787790863.382217:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+5:2399:x1874634250241152:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:1.0:1787790863.382263:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1daf9 00000100:00080000:1.0:1787790863.382276:0:6514:0:(import.c:65:import_set_state_nolock()) ffff916fc31fb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787790863.382313:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787790863.382496:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f47024d7-c694-4b5e-82d5-d65d38352c76+3:2399:x1874634250241152:12345-192.168.202.22@tcp:39:umount.0 Request processed in 280us (3118us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787790863.382504:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 261 00010000:00010000:2.0:1787790863.382841:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790863.424066:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790863.424832:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241408 00000100:00100000:2.0:1787790863.424842:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241408 00000100:00100000:2.0:1787790863.424906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 394 00000100:00100000:2.0:1787790863.424916:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+7:2399:x1874634250241408:12345-192.168.202.22@tcp:251:umount.0 00000020:00000080:2.0:1787790863.424965:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d9b7 00000020:00010000:2.0:1787790863.424973:0:6506:0:(genops.c:1921:obd_stale_export_put()) Put export ffff916fc1c8d000: total 0 00000100:00080000:2.0:1787790863.424977:0:6506:0:(import.c:65:import_set_state_nolock()) ffff916fc1c8f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787790863.425067:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56437f26-ebd6-4232-a9cd-72d1b9652a36+3:2399:x1874634250241408:12345-192.168.202.22@tcp:251:umount.0 Request processed in 152us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790863.425076:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 394 00000020:00010000:0.0:1787790863.425210:0:9514:0:(genops.c:1907:obd_stale_export_get()) Get export ffff916fc1c8d000: total 0 00010000:00010000:0.0:1787790863.425276:0:9514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff916fc1c8d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787790863.425317:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0030c00/0xcf9477fddcf1da90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223aa2 expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790863.425330:0:9514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff916fc1c8d000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787790863.425341:0:9514:0:(genops.c:885:class_export_put()) final put ffff916fc1c8d000/56437f26-ebd6-4232-a9cd-72d1b9652a36 00010000:00010000:0.0:1787790863.425365:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790863.425367:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790863.425369:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787790863.425881:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1c8d000/56437f26-ebd6-4232-a9cd-72d1b9652a36 for MGS 00000020:00000080:2.0:1787790863.425920:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1c8f000 for MGS 00010000:00010000:1.0:1787790864.210854:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790864.211248:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790864.211272:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268105984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790864.211346:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.211410:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268105984 00000100:00100000:0.0:1787790864.211417:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268105984 00000100:00100000:0.0:1787790864.211464:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787790864.211472:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268105984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790864.211498:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790864.211534:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268105984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790864.211541:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1787790864.211558:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790864.211588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268105984:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787790864.214342:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00080000:0.0:1787790864.214360:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1787790864.214378:0:6492:0:(genops.c:885:class_export_put()) final put ffff9170f6791800/f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00100000:0.0:1787790864.216044:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000001:00080000:0.0:1787790864.216057:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1787790864.216071:0:6492:0:(genops.c:885:class_export_put()) final put ffff916fc1c8e000/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:1.0:1787790864.219360:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f6791800/f47024d7-c694-4b5e-82d5-d65d38352c76 for lustre-MDT0000 00000020:00000080:1.0:1787790864.219429:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f6792000 for lustre-MDT0000 00000100:00100000:1.0:1787790864.219446:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790864.219470:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268106112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790864.219551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790864.221121:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106112 00000020:00000080:3.0:1787790864.221205:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1c8e000/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-MDT0000 00000020:00000080:3.0:1787790864.221269:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1c8f800 for lustre-MDT0000 00000100:00100000:0.0:1787790864.221300:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106112 00000100:00100000:0.0:1787790864.221972:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790864.221992:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268106112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790864.222019:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790864.222097:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268106112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790864.222105:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787790864.222179:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268106112:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787790864.227399:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:3.0:1787790865.195023:0:15143:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787790865.211354:0:15143:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787790865.211415:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.211430:0:15143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.211450:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.211458:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.211532:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787790865.211538:0:15143:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787790865.211566:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790865.211570:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787790865.211576:0:15143:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787790865.211601:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9170eef42000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787790865.211765:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268106240:0@lo:39:umount.0 00000100:00100000:3.0:1787790865.211834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790865.214962:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106240 00000100:00100000:2.0:1787790865.214993:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106240 00000100:00100000:2.0:1787790865.215075:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787790865.215086:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874634268106240:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787790865.215132:0:10094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d5ce 00000100:00080000:2.0:1787790865.215142:0:10094:0:(import.c:65:import_set_state_nolock()) ffff9170f3c47000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787790865.219727:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790865.219742:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.219757:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787790865.219762:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.219774:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790865.219782:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790865.219788:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787790865.219808:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787790865.219812:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787790865.219860:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.219867:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790865.219898:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.219906:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38a00/0xcf9477fddcf1da5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da66 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790865.219939:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268106368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790865.220017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790865.220087:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106368 00000100:00100000:0.0:1787790865.220094:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106368 00000100:00100000:0.0:1787790865.220161:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790865.220170:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+24:3638:x1874634268106368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790865.220182:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790865.220198:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1400/0xcf9477fddcf1da66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da5f expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.220211:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790865.220245:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+23:3638:x1874634268106368:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790865.220252:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790865.220290:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268106368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790865.220313:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.220315:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.220323:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790865.220996:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1874634268106240:12345-0@lo:39:umount.0 Request processed in 5909us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790865.221006:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1787790865.221015:0:10094:0:(genops.c:885:class_export_put()) final put ffff9170f3c42800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787790865.221347:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787790865.221366:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268106240:0@lo:39:umount.0 00000020:00000080:3.0:1787790865.221394:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c42800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787790865.221490:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f3c47000 for lustre-MDT0000 00000100:00080000:2.0:1787790865.226027:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790865.226037:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787790865.226044:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787790865.226813:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.227512:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227549:0:15143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227556:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227565:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227583:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.227590:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227597:0:15143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227603:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.227608:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.227810:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.227818:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.227825:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790865.227836:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.227846:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790865.227854:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790865.227860:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787790865.227863:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787790865.227906:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.227912:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790865.227936:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.227943:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff917102178c00/0xcf9477fddcf1da6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.227961:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.227962:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.227964:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790865.228020:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268106496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790865.228090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790865.228753:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790865.228763:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228770:0:15143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228792:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228797:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228808:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787790865.228814:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228820:0:15143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228826:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228832:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790865.228839:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787790865.228843:0:15143:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787790865.228849:0:15143:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787790865.228888:0:15143:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787790865.228891:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787790865.228895:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790865.228902:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1787790865.228908:0:15143:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff916fc3204800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787790865.228914:0:15143:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff916fc1d5b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787790865.228927:0:15143:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9170fbd36000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787790865.228931:0:15143:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9170f503d000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787790865.228937:0:15143:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9170eef519b8) has exports, disconnecting them 00000020:00080000:2.0:1787790865.228941:0:15143:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff916fc3204800), last request at 1787790861 00000020:00000080:2.0:1787790865.228948:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d8de 00000100:00080000:2.0:1787790865.228965:0:15143:0:(import.c:65:import_set_state_nolock()) ffff916fc3201000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787790865.229036:0:15143:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc3204800): rc 0 00000020:00000080:2.0:1787790865.229039:0:15143:0:(genops.c:885:class_export_put()) final put ffff916fc3204800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787790865.229059:0:15143:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff916fc1d5b800), last request at 1787790861 00000020:00000080:2.0:1787790865.229062:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d7b8 00000100:00080000:2.0:1787790865.229067:0:15143:0:(import.c:65:import_set_state_nolock()) ffff916fc1d59800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787790865.229074:0:15143:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc1d5b800): rc 0 00000020:00000080:2.0:1787790865.229075:0:15143:0:(genops.c:885:class_export_put()) final put ffff916fc1d5b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787790865.229079:0:15143:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9170fbd36000), last request at 1787790649 00000020:00000080:2.0:1787790865.229081:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d6f4 00000100:00080000:2.0:1787790865.229084:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9170fbd37000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787790865.229088:0:15143:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170fbd36000): rc 0 00000020:00000080:2.0:1787790865.229090:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170fbd36000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787790865.229093:0:15143:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9170f503d000), last request at 1787790649 00000020:00000080:2.0:1787790865.229096:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d6b5 00000100:00080000:2.0:1787790865.229099:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9170f503d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787790865.229104:0:15143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1787790865.229286:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268106624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790865.229333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.229376:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106496 00000100:00100000:1.0:1787790865.229383:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106496 00000100:00100000:1.0:1787790865.229439:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790865.229448:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+23:3639:x1874634268106496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790865.229463:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790865.229481:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031a00/0xcf9477fddcf1da74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da6d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.229496:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790865.229533:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75db525-924f-489b-b982-1d04f64567fb+22:3639:x1874634268106496:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790865.229541:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787790865.229562:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787790865.229568:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.229575:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e0400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790865.229579:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.229588:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790865.229595:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790865.229600:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787790865.229603:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787790865.229605:0:9514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:2.0:1787790865.229786:0:15143:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170f503d000): rc 0 00000004:00000080:2.0:1787790865.229793:0:15143:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8b300d53ae0 00000100:00080000:2.0:1787790865.229810:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787790865.229816:0:15143:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3b90780 x1874634268106624/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787790881 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790865.229842:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1787790865.230598:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787790865.230607:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.230618:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787790865.230622:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.230630:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790865.230637:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790865.230642:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787790865.230645:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787790865.230647:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787790865.230669:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.230674:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790865.230688:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.230695:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e400/0xcf9477fddcf1dcd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1dcdc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790865.230731:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268106880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790865.231201:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231225:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790865.231234:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231241:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e0400/0xcf9477fddcf1d971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231253:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790865.231258:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231265:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790865.231269:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231276:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790865.231282:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790865.231287:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787790865.231289:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787790865.231292:0:9514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787790865.231311:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231317:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790865.231324:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231341:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c165f600/0xcf9477fddcf1d52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d534 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.231353:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.231355:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790865.231357:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790865.231380:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106624 00000100:00100000:1.0:1787790865.231387:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106624 00000100:00100000:1.0:1787790865.231437:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787790865.231447:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268106624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790865.231488:0:7807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787790865.231490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.231543:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268106624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790865.231545:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790865.231551:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787790865.231558:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268107008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790865.231576:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106880 00000100:00100000:1.0:1787790865.231579:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106880 00000100:00100000:0.0:1787790865.231583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.231603:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107008 00000100:00100000:1.0:1787790865.231607:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107008 00000100:00100000:0.0:1787790865.231612:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787790865.231619:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+23:3638:x1874634268106880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790865.231631:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790865.231646:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1dcdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1dcd5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.231659:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790865.231685:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+22:3638:x1874634268106880:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790865.231691:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:3.0:1787790865.231741:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3204800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1787790865.231742:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268106880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790865.231770:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787790865.231779:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1d5b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787790865.231803:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170fbd36000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787790865.231825:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc3201000 for lustre-MDT0000 00000020:00000080:3.0:1787790865.231830:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1d59800 for lustre-MDT0000 00000020:00000080:3.0:1787790865.231833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170fbd37000 for lustre-MDT0000 00010000:00010000:0.0:1787790865.233507:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790865.233518:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790865.235885:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790865.235901:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+21:3638:x1874634268107008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790865.235919:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790865.235941:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39e00/0xcf9477fddcf1d978 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d971 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790865.235957:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790865.236040:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75db525-924f-489b-b982-1d04f64567fb+20:3638:x1874634268107008:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (4455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790865.236066:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790865.236107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268107136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790865.238874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.238946:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268106624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790865.238995:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790865.239007:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268106752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790865.239039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790865.239092:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268106752 00000100:00100000:1.0:1787790865.239102:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268106752 00000100:00100000:0.0:1787790865.239174:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268107008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790865.239821:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107136 00000100:00100000:0.0:1787790865.239827:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107136 00000100:00100000:0.0:1787790865.239879:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790865.239890:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+20:3640:x1874634268107136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790865.239926:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790865.239947:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e0a00/0xcf9477fddcf1d534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d52d expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790865.239967:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790865.240024:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75db525-924f-489b-b982-1d04f64567fb+19:3640:x1874634268107136:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790865.240047:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787790865.240072:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790865.240089:0:15143:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787790865.240112:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9170f3e07000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787790865.240165:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268106496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790865.241783:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787790865.241794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874634268106752:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787790865.241804:0:6518:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787790865.241866:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874634268106752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (2826us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787790865.241873:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:02020000:1.0:1787790865.242094:0:3640:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1787790865.242506:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268107264:0@lo:39:umount.0 00000100:00100000:3.0:1787790865.242555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787790865.242739:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787790865.242744:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787790865.242759:0:15143:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787790865.242826:0:15143:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787790865.242848:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9170f67c9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787790865.242858:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787790865.242861:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787790865.242869:0:15143:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787790865.242944:0:15143:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787790865.242952:0:15143:0:(import.c:65:import_set_state_nolock()) ffff916fc3449000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787790865.242992:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9170eef519b8) has no exports 00000100:00100000:0.0:1787790865.243770:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107264 00000100:00100000:0.0:1787790865.243779:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107264 00000100:00100000:0.0:1787790865.243819:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787790865.243827:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874634268107264:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787790865.243859:0:7807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d702 00000100:00080000:0.0:1787790865.243867:0:7807:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787790865.243888:0:7807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787790865.244062:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3637:x1874634268107264:12345-0@lo:39:umount.0 Request processed in 235us (1505us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787790865.244070:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787790865.244805:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268107392:0@lo:9:umount.0 00000100:00100000:3.0:1787790865.244862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790865.244893:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268107520:0@lo:9:umount.0 00000100:00100000:3.0:1787790865.244915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787790865.244968:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3e07000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787790865.244988:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268107264:0@lo:39:umount.0 00000100:00100000:3.0:1787790865.245104:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107392 00000100:00100000:3.0:1787790865.245109:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107392 00000100:00100000:3.0:1787790865.245742:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107520 00000100:00100000:3.0:1787790865.245748:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107520 00000100:00100000:3.0:1787790865.245781:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790865.245790:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874634268107392:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787790865.245814:0:10092:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d860 00000100:00080000:3.0:1787790865.245822:0:10092:0:(import.c:65:import_set_state_nolock()) ffff916fc241b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790865.245861:0:10092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787790865.245993:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1874634268107392:12345-0@lo:9:umount.0 Request processed in 204us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790865.246001:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790865.246016:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787790865.246023:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874634268107520:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787790865.246036:0:10092:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d9b0 00000100:00080000:3.0:1787790865.246041:0:10092:0:(import.c:65:import_set_state_nolock()) ffff916fc344e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790865.246063:0:10092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:0.0:1787790865.246308:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787790865.247472:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67c9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787790865.247498:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787790865.247501:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787790865.247507:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268107392:0@lo:9:umount.0 00000100:00080000:0.0:1787790865.247543:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790865.248056:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1874634268107520:12345-0@lo:9:umount.0 Request processed in 2030us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790865.248068:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787790865.248111:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc3449000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787790865.248701:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787790865.248728:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787790865.248734:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268107520:0@lo:9:umount.0 00010000:00010000:0.0:1787790865.248837:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790865.251818:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787790865.256755:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787790865.256764:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787790865.256769:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787790865.273114:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790865.273129:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:1.0:1787790865.273140:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170f530d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790865.273185:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebde00 x1874634268107648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790865.273255:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268107648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787790865.273330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790865.274096:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107648 00000100:00100000:3.0:1787790865.274105:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107648 00000100:00100000:3.0:1787790865.274169:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787790865.274179:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1874634268107648:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787790865.274199:0:7807:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787790865.276812:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1874634268107648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2625us (3473us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787790865.276827:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787790865.277880:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268107136:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787790865.279538:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790865.279550:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787790865.279555:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268107648:0@lo:38:ptlrpcd_00_02.0 00000020:00080000:2.0:1787790865.293105:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9170eef519b8) has no exports 00000020:00000080:2.0:1787790865.368360:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d588 00000020:00000080:2.0:1787790865.368387:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f3c43800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787790865.368404:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787790865.369635:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c43800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787790865.369669:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790865.369682:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787790865.369686:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9170eef54d28) has no exports 00000020:00000080:3.0:1787790865.370488:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d581 00000020:00000080:3.0:1787790865.370500:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f3c18000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790865.370578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c18000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787790865.375485:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790865.375505:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787790865.375511:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f3c1b000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787790865.375517:0:15143:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c1b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787790865.375523:0:15143:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787790866.252692:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790866.764065:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790866.764072:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787790866.764076:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790866.764085:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:2.0:1787790866.764091:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787790866.764099:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170f530d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790866.764131:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790866.764137:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a05680 x1874634268107904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790866.764153:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268107776:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.764277:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268108032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.764339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.774743:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268108544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.774814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.774835:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790866.774841:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268108160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790866.774865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.774907:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108544 00000100:00100000:0.0:1787790866.774914:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108544 00000100:00100000:0.0:1787790866.774989:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787790866.774999:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268108544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.775063:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268108544:12345-0@lo:400:kworker.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790866.775070:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787790866.775093:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108160 00000100:00100000:0.0:1787790866.775097:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108160 00000100:00100000:0.0:1787790866.775124:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787790866.775130:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268108160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790866.775152:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787790866.775182:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268108160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790866.775188:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1787790866.775203:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787790866.775207:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790866.775410:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268108160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790866.775423:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268108544:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.775464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.775517:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268108288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.775545:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.775571:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790866.775578:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268108416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.775599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.775620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108032 00000100:00100000:0.0:1787790866.775624:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108032 00000100:00100000:0.0:1787790866.775644:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108288 00000100:00100000:0.0:1787790866.775647:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108288 00000100:00100000:0.0:1787790866.775663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108416 00000100:00100000:0.0:1787790866.775666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108416 00000100:00100000:0.0:1787790866.775724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787790866.775732:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268108416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790866.775981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787790866.775987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874634268108032:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787790866.775994:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787790866.776071:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107776 00000100:00100000:3.0:1787790866.776076:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107776 00000100:00100000:3.0:1787790866.776105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787790866.776112:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:3640:x1874634268107776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790866.776607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874634268108032:12345-0@lo:400:kworker.0 Request processed in 616us (12265us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787790866.776614:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787790866.776632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787790866.776637:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874634268108288:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787790866.776641:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787790866.776664:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874634268108288:12345-0@lo:400:kworker.0 Request processed in 26us (1118us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787790866.776670:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00080000:1.0:1787790866.776779:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4588000 x1874634268108416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790866.776791:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268108416:0@lo:400:kworker.0 00000100:00080000:1.0:1787790866.776804:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787790866.776809:0:3640:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787790866.776813:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787790866.779035:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790866.779062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268108800:0@lo:400:kworker.0 00000100:00100000:2.0:1787790866.779139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790866.779198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108800 00000100:00100000:2.0:1787790866.779207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108800 00000100:00100000:2.0:1787790866.779266:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787790866.779277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268108800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790866.779328:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268108800:12345-0@lo:400:kworker.0 Request processed in 54us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790866.779334:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:2.0:1787790866.779371:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458ad00 x1874634268108800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790866.779385:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268108800:0@lo:400:kworker.0 00000100:00100000:2.0:1787790866.779453:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268107904:0@lo:38:kworker.0 00000100:00100000:2.0:1787790866.779481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790866.779522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268107904 00000100:00100000:2.0:1787790866.779526:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268107904 00000100:00100000:2.0:1787790866.779545:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787790866.779550:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268107904:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787790866.779565:0:6518:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787790866.785905:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170cea0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a75db525-924f-489b-b982-1d04f64567fb+19:3640:x1874634268107776:12345-0@lo:400:kworker.0 Request processed in 9779us (10425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790866.785922:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787790866.787059:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268108416:12345-0@lo:400:kworker.0 Request processed in 11322us (11452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790866.787315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:0.0:1787790866.787349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790866.787416:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268108672:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.787878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.787931:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108672 00000100:00100000:0.0:1787790866.787939:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108672 00000100:00100000:0.0:1787790866.787985:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787790866.787993:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1874634268108672:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787790866.788002:0:10093:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787790866.790206:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1874634268108672:12345-0@lo:400:kworker.0 Request processed in 2204us (2321us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787790866.790220:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1787790866.791000:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787790866.791382:0:3639:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787790866.791387:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787790866.791393:0:3639:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790866.791397:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 232 00000100:00080000:3.0:1787790866.791406:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc344f000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790866.791452:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ac780 x1874634268108928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790866.791486:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268108672:0@lo:400:kworker.0 00000100:00100000:3.0:1787790866.791528:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268108928:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787790866.791581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790866.791625:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268108928 00000100:00100000:3.0:1787790866.791631:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268108928 00000100:00100000:3.0:1787790866.791664:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787790866.791671:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268108928:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787790866.791688:0:6513:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787790866.791764:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268108928:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 91us (183us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787790866.791770:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1787790866.791799:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790866.791804:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787790866.791806:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268108928:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787790866.791942:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787790866.791952:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9170fbd33800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787790866.791956:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787790866.792403:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9170fbd33800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790866.792408:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:0.0:1787790866.792414:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9170fbd33800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790866.792443:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4596580 x1874634268109056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790866.792462:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268108032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.792486:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268109056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787790866.792519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.792554:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109056 00000100:00100000:0.0:1787790866.792559:0:10094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109056 00000100:00100000:0.0:1787790866.792583:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787790866.792589:0:10094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1874634268109056:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787790866.792599:0:10094:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787790866.792631:0:10094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1874634268109056:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41us (112us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787790866.792637:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1787790866.792661:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170fbd33800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790866.792665:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790866.792668:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268109056:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:3.0:1787790866.794517:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787790866.794531:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787790866.794536:0:7443:0:(genops.c:885:class_export_put()) final put ffff9170f3c79000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787790866.794564:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00080000:3.0:1787790866.794571:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787790866.794573:0:7443:0:(genops.c:885:class_export_put()) final put ffff9170f6795000/f47024d7-c694-4b5e-82d5-d65d38352c76 00000001:00100000:3.0:1787790866.794579:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000001:00080000:3.0:1787790866.794583:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787790866.794584:0:7443:0:(genops.c:885:class_export_put()) final put ffff916fc1c8c800/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:0.0:1787790866.794901:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787790866.794974:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f6795000/f47024d7-c694-4b5e-82d5-d65d38352c76 for lustre-MDT0001 00000020:00000080:0.0:1787790866.794999:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1c8c800/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-MDT0001 00000020:00000080:0.0:1787790866.796412:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ceb1d800 for lustre-MDT0001 00000020:00000080:0.0:1787790866.796430:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc31fb000 for lustre-MDT0001 00000020:00000080:0.0:1787790866.796434:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1c88000 for lustre-MDT0001 00000100:00080000:1.0:1787790866.806541:0:3640:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790866.806553:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 215 00000100:00080000:1.0:1787790866.806562:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc2418000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790866.806858:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4596580 x1874634268109184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790866.806880:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268108288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790866.806895:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268109184:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787790866.806955:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790866.807027:0:10093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109184 00000100:00100000:0.0:1787790866.807034:0:10093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109184 00000100:00100000:0.0:1787790866.807070:0:10093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787790866.807077:0:10093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874634268109184:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787790866.807091:0:10093:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787790866.807341:0:10093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874634268109184:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 263us (386us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787790866.807347:0:10093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787790866.807375:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790866.807378:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790866.807380:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268109184:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787790866.807398:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268107776:0@lo:400:kworker.0 00000100:00100000:2.0:1787790866.810458:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268107904:12345-0@lo:38:kworker.0 Request processed in 30897us (30966us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787790866.810472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1787790866.810610:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790866.810617:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790866.810621:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268107904:0@lo:38:kworker.0 00000001:00100000:0.0:1787790866.811870:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787790866.811879:0:8420:0:(genops.c:885:class_export_put()) final put ffff916fc241e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787790866.811915:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:0.0:1787790866.811917:0:8420:0:(genops.c:885:class_export_put()) final put ffff9170c4cc8000/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:1.0:1787790866.811980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc241e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787790866.813699:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c4cc8000/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-OST0000 00000020:00000080:1.0:1787790866.813759:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc241b800 for lustre-OST0000 00000020:00000080:1.0:1787790866.813765:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170c4cce000 for lustre-OST0000 00000001:00100000:2.0:1787790866.820092:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790866.820103:0:9504:0:(genops.c:885:class_export_put()) final put ffff916fc344b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787790866.820154:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:2.0:1787790866.820157:0:9504:0:(genops.c:885:class_export_put()) final put ffff9170c355d000/a61a333f-852a-40de-8207-4f7de209a9a4 00000020:00000080:0.0:1787790866.820463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc344b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787790866.820518:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c355d000/a61a333f-852a-40de-8207-4f7de209a9a4 for lustre-OST0001 00000020:00000080:0.0:1787790866.820540:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc344e800 for lustre-OST0001 00000020:00000080:0.0:1787790866.820547:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170c355d800 for lustre-OST0001 00010000:00010000:0.0:1787790867.275222:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790868.299877:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787790868.619467:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787790869.323131:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790869.323156:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268109312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790869.323230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790869.323410:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109312 00000100:00100000:0.0:1787790869.323420:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109312 00000100:00100000:0.0:1787790869.323504:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787790869.323516:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268109312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790869.323554:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787790869.323598:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268109312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790869.323606:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1787790869.323670:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790869.323728:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268109312:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787790869.324252:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790870.350239:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787790870.864168:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790870.864178:0:6492:0:(genops.c:885:class_export_put()) final put ffff9170f503d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787790870.872914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f503d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787790870.872984:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f503d800 for lustre-MDT0000 00010000:00010000:3.0:1787790871.372376:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787790871.434871:0:15143:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc302ef60 - data ffff9170d6892bd0/ffff916fc303bc00 00000020:01000000:3.0:1787790871.435027:0:15143:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170edb00de0 - data ffff9170d697c948/ffff9170f3ed9c00 00000001:00000004:3.0:1787790871.444927:0:15143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1787790871.516927:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787790871.516936:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787790871.516950:0:15143:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff916fc3a052c0 x1874634268107264/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787790875 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790871.516977:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787790871.519534:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787790871.519544:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1787790871.519734:0:15143:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787790871.519737:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787790871.520075:0:8636:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787790871.520082:0:8636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1787790871.520092:0:8636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787790871.520654:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787790871.520657:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787790871.520677:0:15143:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787790871.520679:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787790871.521094:0:9994:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787790871.521098:0:9994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787790871.521106:0:9994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787790871.525996:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d550 00000020:00000080:1.0:1787790871.526010:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170eef46000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790871.526701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef46000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787790871.528554:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d565 00000020:00000080:1.0:1787790871.528568:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170eef5e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787790871.528682:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787790871.528687:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.528695:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787790871.528699:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9170eef30000) has no exports 00000004:01000000:1.0:1787790871.528899:0:15143:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787790871.528907:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d99b 00000020:00000080:1.0:1787790871.528912:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f503c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790871.530529:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef5e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787790871.530697:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787790871.530716:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.530731:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787790871.530736:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff916fc34a99b8) has no exports 00000020:00000080:1.0:1787790871.530744:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d994 00000020:00000080:1.0:1787790871.530751:0:15143:0:(genops.c:885:class_export_put()) final put ffff916fc344a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790871.530847:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f503c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1787790871.533258:0:15143:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787790871.533267:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787790871.533271:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1787790871.533281:0:15143:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787790871.533283:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790871.533345:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc344a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787790871.533505:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.533522:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787790871.533530:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d859 00000020:00000080:1.0:1787790871.533540:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f67a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790871.533559:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc3449000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787790871.533565:0:37:0:(genops.c:885:class_export_put()) final put ffff916fc3449800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790871.533568:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3449800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787790871.533860:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787790871.534033:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787790871.534037:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.534044:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787790871.534048:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9170f52fb370) has no exports 00000020:00000080:1.0:1787790871.534054:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d852 00000020:00000080:1.0:1787790871.534059:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f67ca800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790871.534182:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f67a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787790871.534653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f67ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787790871.537372:0:15143:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787790871.537442:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787790871.537446:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787790871.537455:0:15143:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787790871.537457:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787790871.537518:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.537532:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787790871.537551:0:15143:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787790871.537558:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d68b 00000020:00000080:1.0:1787790871.537568:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f3c78000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787790871.537575:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787790871.537582:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790871.537829:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f67c9000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787790871.537838:0:37:0:(genops.c:885:class_export_put()) final put ffff9170f677f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790871.537841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f677f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787790871.537849:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787790871.537956:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787790871.541537:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787790871.541543:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9170eef33370) has no exports 00000020:00000080:1.0:1787790871.541554:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d684 00000020:00000080:1.0:1787790871.541563:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f3e01800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790871.541744:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3e01800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787790871.584254:0:15143:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787790871.584276:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787790871.584280:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787790871.584289:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787790871.584398:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.584414:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787790871.584459:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.584463:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787790871.584471:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170d0fad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787790871.584477:0:15143:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d0fad000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787790871.584496:0:15143:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787790871.584639:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d56c 00000020:00000080:1.0:1787790871.584648:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170eef59800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787790871.585041:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f3e07000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787790871.585051:0:37:0:(genops.c:885:class_export_put()) final put ffff9170f3e24000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787790871.585053:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3e24000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787790871.585062:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787790871.585306:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787790871.585312:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.585320:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787790871.585325:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9170eef50000) has no exports 00000020:00000080:1.0:1787790871.585420:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.585425:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787790871.585429:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d573 00000020:00000080:1.0:1787790871.585435:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170eef5b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790871.585457:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef59800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787790871.585462:0:37:0:(genops.c:885:class_export_put()) final put ffff9170eef59000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787790871.585464:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef59000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787790871.585468:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1787790871.585540:0:15143:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170c2ab0800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787790871.585550:0:15143:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170c2ab0800 3 00000020:01000004:1.0:1787790871.585560:0:15143:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170c2ab0800 from lustre-MDT0000 00000020:00000080:2.0:1787790871.585574:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787790871.585740:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.585746:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787790871.585749:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170eef5c000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787790871.585751:0:15143:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef5c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787790871.585760:0:15143:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787790871.585943:0:15143:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787790871.585948:0:15143:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787790871.585951:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787790871.585954:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.585965:0:15143:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787790871.585973:0:15143:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9170ce83c000 a75db525-924f-489b-b982-1d04f64567fb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790871.585979:0:15143:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9170d6384d28) has exports, disconnecting them 00000020:00080000:1.0:1787790871.585983:0:15143:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9170ce83c000), last request at 1787790632 00000020:00000080:1.0:1787790871.586001:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d511 00000020:00010000:1.0:1787790871.586005:0:15143:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9170ce83c000: total 0 00000100:00080000:1.0:1787790871.586009:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9170ce83e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787790871.586028:0:15143:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170ce83c000): rc 0 00000020:00080000:1.0:1787790871.586032:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9170d6384d28) has no exports 00000100:00100000:2.0:1787790871.586139:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff917101145e00:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1787790871.586224:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9170df067400:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1787790871.586246:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9170df067800:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1787790871.586308:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586315:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586321:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586327:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586333:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586338:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586344:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586349:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1787790871.586397:0:6502:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9170ce83c000: total 0 00000100:00100000:1.0:1787790871.586428:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787790871.586440:0:6502:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9170ce83c000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787790871.586472:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1dcce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1dcc7 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586487:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd38c00/0xcf9477fddcf1da82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da7b expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586498:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39600/0xcf9477fddcf1da12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da0b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586508:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1dcc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1dcb9 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586519:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c0031800/0xcf9477fddcf1da20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da19 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586529:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1d932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d92b expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586543:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1600/0xcf9477fddcf1da2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da27 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586554:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e0200/0xcf9477fddcf1da4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da43 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586565:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd39800/0xcf9477fddcf1da3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da35 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586590:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1c00/0xcf9477fddcf1d61b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d614 expref: 5 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586603:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e200/0xcf9477fddcf1dcb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1dcab expref: 4 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586615:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e1e00/0xcf9477fddcf1da58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1da51 expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586627:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c29e0600/0xcf9477fddcf1d60d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1d606 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790871.586637:0:6502:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9170ce83c000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1787790871.586644:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787790871.586656:0:6502:0:(genops.c:885:class_export_put()) final put ffff9170ce83c000/a75db525-924f-489b-b982-1d04f64567fb 00010000:00010000:0.0:1787790871.586677:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790871.586680:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790871.586682:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790871.586744:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586755:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586761:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586767:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.586772:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787790871.586971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ce83c000/a75db525-924f-489b-b982-1d04f64567fb for MGS 00000020:00000080:2.0:1787790871.587006:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ce83e800 for MGS 00000100:00100000:1.0:1787790871.587014:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587026:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587032:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587039:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587048:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587055:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587061:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587068:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587082:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587089:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587095:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587100:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587105:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587111:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587116:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587122:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587127:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587136:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587204:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587211:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587219:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587226:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587233:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587240:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587248:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587255:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587262:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587269:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587277:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587284:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587295:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587304:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587312:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587320:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587332:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587342:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587353:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587429:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587434:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587440:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587446:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587451:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587462:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587474:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587479:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587484:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587491:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587499:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790871.587507:0:15143:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787790871.589233:0:15143:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc302eae0 - data ffff916fc20b7288/ffff916fc303b400 00000020:01000000:1.0:1787790871.589419:0:15143:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170d6239480 - data ffff9170d1b510d8/ffff9170d63af400 00000020:00000080:1.0:1787790871.590133:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d4f5 00000020:00000080:1.0:1787790871.590214:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170ceb18800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787790871.590236:0:15143:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170c2ab0800 from MGS, refs=2 00000020:01000004:1.0:1787790871.590239:0:15143:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170c2ab0800 2 00000020:01000004:1.0:1787790871.590242:0:15143:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170c2ab0800 from MGS 00000020:00000080:1.0:1787790871.590268:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.590274:0:15143:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787790871.590277:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170ceb1a800/MGS 00000020:00000080:1.0:1787790871.590279:0:15143:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb1a800/MGS for MGS 00000020:01000000:1.0:1787790871.590285:0:15143:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787790871.590348:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787790871.590352:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.590426:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787790871.590433:0:15143:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9170f3c7b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790871.590439:0:15143:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9170eef34d28) has exports, disconnecting them 00000020:00080000:1.0:1787790871.590444:0:15143:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9170f3c7b800), last request at 1787790633 00000020:00000080:1.0:1787790871.590448:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d5c0 00000020:00080000:1.0:1787790871.590454:0:15143:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170f3c7b800): rc 0 00000020:00000080:1.0:1787790871.590459:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170f3c7b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787790871.590491:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb18800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787790871.590510:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c7b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787790871.591463:0:15143:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787790871.591471:0:15143:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787790871.591476:0:15143:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787790871.591482:0:15143:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787790871.591675:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170eef42000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787790871.592112:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790871.592129:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787790871.592134:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170eef45000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787790871.592209:0:15143:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef45000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787790871.592215:0:15143:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787790871.592961:0:15143:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170c2ab0800 1 00000020:00000080:1.0:1787790871.592980:0:15143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d4e7 00000020:00000080:1.0:1787790871.592988:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170ceb1a000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787790871.593012:0:15143:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787790871.593017:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790871.593023:0:15143:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787790871.593027:0:15143:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9170d6380000) has no exports 00000020:00000080:0.0:1787790871.593038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb1a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787790871.670354:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790871.670369:0:15143:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787790871.670375:0:15143:0:(genops.c:885:class_export_put()) final put ffff9170c2ab7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787790871.670380:0:15143:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c2ab7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787790871.670386:0:15143:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787790871.670524:0:15143:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170c2ab1000 00000020:02000400:2.0:1787790871.670584:0:15143:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1787790871.883464:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268109440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790871.884172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790871.884444:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109440 00000100:00100000:0.0:1787790871.884483:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109440 00000100:00100000:0.0:1787790871.884580:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787790871.884591:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268109440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790871.884646:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787790871.885281:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268109440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 690us (1109us total) trans 0 rc 0/0 00000100:00080000:3.0:1787790871.885996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790871.886017:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268109568:0@lo:400:kworker.0 00000400:00000100:3.0:1787790871.886060:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268109568 offset 0 length 224: 4 00000100:00100000:3.0:1787790871.886134:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268109440:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787790871.886893:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790871.886899:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787790871.886903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790871.886909:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1787790871.886923:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787790871.886931:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170f530d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790871.886964:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4589680 x1874634268109696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790871.886986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790871.886990:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787790871.886992:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170fbd33800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790871.887004:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1787790871.887007:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787790871.887011:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9170fbd33800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790871.887024:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4588000 x1874634268109824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790871.887032:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790871.887035:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787790871.887037:0:37:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790871.887040:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1787790871.887043:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787790871.887047:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc2418000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790871.887059:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4589e00 x1874634268109952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790871.887094:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790871.887097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787790871.887099:0:37:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790871.887102:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1787790871.887104:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787790871.887107:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc344f000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790871.887117:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe89e00 x1874634268110336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787790871.887158:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268110080:0@lo:400:kworker.0 00000100:00100000:2.0:1787790871.887208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790871.887239:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790871.887253:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268110208:0@lo:400:kworker.0 00000100:00100000:2.0:1787790871.887281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790871.887310:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268110464:0@lo:400:kworker.0 00000100:00100000:2.0:1787790871.887335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790871.887385:0:10092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110208 00000100:00100000:2.0:1787790871.887392:0:10092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110208 00000100:00100000:2.0:1787790871.887448:0:10092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787790871.887458:0:10092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268110208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790871.887514:0:10092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268110208:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790871.887522:0:10092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787790871.887544:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790871.887664:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268110208:0@lo:400:kworker.0 00000100:00100000:0.0:1787790871.889859:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787790871.889925:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268109696:0@lo:38:kworker.0 00000100:00100000:0.0:1787790871.889991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790871.890028:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268109824:0@lo:38:kworker.0 00000100:00100000:0.0:1787790871.890052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790871.890071:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268109952:0@lo:38:kworker.0 00000100:00100000:0.0:1787790871.890091:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790871.890105:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268110336:0@lo:38:kworker.0 00000100:00100000:0.0:1787790871.890124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790871.890155:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110080 00000100:00100000:0.0:1787790871.890162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110080 00000100:00100000:0.0:1787790871.890210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110464 00000100:00100000:0.0:1787790871.890214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110464 00000100:00100000:0.0:1787790871.890228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109824 00000100:00100000:0.0:1787790871.890231:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109824 00000100:00100000:0.0:1787790871.890239:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109952 00000100:00100000:0.0:1787790871.890241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109952 00000100:00100000:0.0:1787790871.890249:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110336 00000100:00100000:0.0:1787790871.890251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110336 00000100:00100000:0.0:1787790871.890263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787790871.890272:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268110080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790871.890408:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787790871.890421:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268110464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790871.890480:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268110464:12345-0@lo:400:kworker.0 Request processed in 63us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790871.890488:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787790871.890504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790871.890508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268109824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787790871.890528:0:6513:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787790871.890565:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268109824:12345-0@lo:38:kworker.0 Request processed in 55us (511us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787790871.890571:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787790871.890582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787790871.890594:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268109952:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787790871.890604:0:6513:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787790871.890632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268109952:12345-0@lo:38:kworker.0 Request processed in 37us (540us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787790871.890640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787790871.890656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787790871.890661:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268110336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787790871.890670:0:6513:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787790871.890693:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268110336:12345-0@lo:38:kworker.0 Request processed in 31us (568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787790871.890699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:2.0:1787790871.890751:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe8b0c0 x1874634268110464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790871.890764:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268110464:0@lo:400:kworker.0 00000100:00100000:0.0:1787790871.891370:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268110080:12345-0@lo:400:kworker.0 Request processed in 1098us (4160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790871.891378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787790871.891423:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268109696 00000100:00100000:0.0:1787790871.891429:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268109696 00000100:00100000:0.0:1787790871.891450:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787790871.891455:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1874634268109696:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787790871.891467:0:7807:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787790871.891498:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1874634268109696:12345-0@lo:38:kworker.0 Request processed in 42us (1508us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787790871.891503:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1787790871.891526:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790871.891554:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790871.891559:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790871.891563:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268109696:0@lo:38:kworker.0 00000100:00080000:0.0:1787790871.891574:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170fbd33800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790871.891577:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790871.891580:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268109824:0@lo:38:kworker.0 00000100:00080000:0.0:1787790871.891587:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790871.891590:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790871.891592:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268109952:0@lo:38:kworker.0 00000100:00080000:0.0:1787790871.891601:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790871.891604:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790871.891606:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268110336:0@lo:38:kworker.0 00010000:00080000:0.0:1787790871.891643:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458a580 x1874634268110080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790871.891655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268110080:0@lo:400:kworker.0 00010000:00010000:3.0:1787790872.403890:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790873.426030:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790874.443883:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790874.444008:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790874.444028:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268110592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787790874.444089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790874.444176:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110592 00000100:00100000:0.0:1787790874.444184:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110592 00000100:00100000:0.0:1787790874.444246:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787790874.444256:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268110592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790874.444286:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787790874.444368:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790874.444520:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268110592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 265us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790874.444528:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787790874.446449:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268110592:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1787790875.134315:0:15346:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787790875.156988:0:15346:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787790875.157062:0:15346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.157082:0:15346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.157090:0:15346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.157097:0:15346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790875.157114:0:15346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787790875.157119:0:15346:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787790875.157155:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787790875.157159:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787790875.157164:0:15346:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787790875.157169:0:15346:0:(import.c:65:import_set_state_nolock()) ffff9170fbd33800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787790875.157174:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787790875.157192:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787790875.157195:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787790875.159838:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790875.159851:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.159861:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790875.159865:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.159875:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790875.159893:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790875.159910:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790875.159913:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787790875.159916:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787790875.159953:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.159960:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790875.159981:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.159988:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38600/0xcf9477fddcf1da43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.159990:0:15346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.159998:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790875.159998:0:15346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.159999:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790875.160001:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790875.160005:0:15346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160012:0:15346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790875.160128:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268110720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790875.160191:0:15346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790875.160200:0:15346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790875.160201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790875.160207:0:15346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160223:0:15346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160230:0:15346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160242:0:15346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790875.160247:0:15346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160253:0:15346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160259:0:15346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160265:0:15346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160278:0:15346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787790875.160284:0:15346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160287:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787790875.160291:0:15346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160292:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160298:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd38e00 already unused, calling callback (ffffffffc11c1c20) 00010000:00010000:1.0:1787790875.160298:0:15346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790875.160302:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160308:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160313:0:15346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790875.160320:0:15346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787790875.160324:0:15346:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1787790875.160350:0:15346:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787790875.160502:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 10000000:00010000:2.0:1787790875.160505:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787790875.160506:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:2.0:1787790875.160510:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790875.160512:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000020:00000080:1.0:1787790875.160512:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:01000000:2.0:1787790875.160514:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00080000:1.0:1787790875.160517:0:15346:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9170fbdf4800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790875.160522:0:15346:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff916fc241f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790875.160527:0:15346:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9170facf0000) has exports, disconnecting them 00010000:00010000:2.0:1787790875.160529:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787790875.160531:0:15346:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9170fbdf4800), last request at 1787790871 00010000:00010000:2.0:1787790875.160535:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1787790875.160537:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d8f3 00010000:00010000:2.0:1787790875.160545:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787790875.160548:0:15346:0:(import.c:65:import_set_state_nolock()) ffff9170fbdf1000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787790875.160552:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd38e00/0xcf9477fddcf1da51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1da58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160561:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787790875.160564:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160569:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ec00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790875.160572:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160578:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787790875.160581:0:15346:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170fbdf4800): rc 0 00000020:00000080:1.0:1787790875.160584:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170fbdf4800/lustre-MDT0001-lwp-OST0001_UUID 10000000:00010000:2.0:1787790875.160585:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787790875.160589:0:15346:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff916fc241f800), last request at 1787790871 00000020:00000080:1.0:1787790875.160593:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d7cd 00000100:00080000:1.0:1787790875.160597:0:15346:0:(import.c:65:import_set_state_nolock()) ffff916fc241c800 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1787790875.160598:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790875.160600:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787790875.160602:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1787790875.160602:0:15346:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc241f800): rc 0 00000020:00000080:1.0:1787790875.160605:0:15346:0:(genops.c:885:class_export_put()) final put ffff916fc241f800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787790875.160611:0:15346:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa8b30166bae0 00010000:00010000:2.0:1787790875.160614:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160619:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1787790875.160628:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787790875.160635:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790875.160635:0:15346:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff916fc44603c0 x1874634268106752/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787790881 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787790875.160642:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9ec00/0xcf9477fddcf1d92b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d932 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790875.160645:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1787790875.160653:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790875.160656:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160662:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790875.160665:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160671:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790875.160677:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790875.160682:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787790875.160684:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787790875.160686:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787790875.160723:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160729:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790875.160736:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160802:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1dcc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1dcce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160812:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790875.160815:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160820:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c29e1a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790875.160823:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160830:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790875.160835:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790875.160840:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790875.160842:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787790875.160844:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787790875.160857:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160863:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790875.160869:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160880:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1a00/0xcf9477fddcf1d614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1d61b expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790875.160902:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790875.160904:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790875.160906:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790875.160917:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268110848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790875.160945:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790875.160967:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790875.160973:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268111232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790875.160993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790875.161024:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268106752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790875.161046:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268110976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790875.161069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790875.161084:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787790875.161090:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268111104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790875.161110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790875.161136:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110720 00000100:00100000:2.0:1787790875.161141:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110720 00000100:00100000:2.0:1787790875.161165:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110848 00000100:00100000:2.0:1787790875.161167:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110848 00000100:00100000:2.0:1787790875.161174:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268111232 00000100:00100000:2.0:1787790875.161176:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268111232 00000100:00100000:2.0:1787790875.161182:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268110976 00000100:00100000:2.0:1787790875.161184:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268110976 00000100:00100000:2.0:1787790875.161189:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268111104 00000100:00100000:2.0:1787790875.161191:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268111104 00000100:00100000:2.0:1787790875.161210:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787790875.161215:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1874634268110720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787790875.161288:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790875 with bad export cookie 14957712194621527313 00000020:00000080:0.0:1787790875.161853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170fbdf4800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787790875.161903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc241f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787790875.161926:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170fbdf1000 for lustre-MDT0001 00000020:00000080:0.0:1787790875.161930:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc241c800 for lustre-MDT0001 00000100:00100000:0.0:1787790875.161948:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790875.161954:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268110848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787790875.161958:0:8442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790875 with bad export cookie 14957712194621527313 00000100:00100000:0.0:1787790875.162012:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268110848:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1065us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787790875.162019:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790875.162050:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790875.162054:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268111232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787790875.162059:0:8442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790875 with bad export cookie 14957712194621527313 00000100:00100000:0.0:1787790875.162084:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268111232:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (1089us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787790875.162089:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787790875.162102:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790875.162106:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268110976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787790875.162110:0:8442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790875 with bad export cookie 14957712194621527313 00000100:00100000:0.0:1787790875.162138:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268110976:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (1068us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787790875.162144:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790875.162155:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787790875.162158:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268111104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787790875.162174:0:8442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787790875 with bad export cookie 14957712194621527313 00000100:00100000:0.0:1787790875.162199:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268111104:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (1088us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787790875.162205:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787790875.162245:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787790875.162248:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787790875.162252:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787790875.163209:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790875.163216:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787790875.163833:0:15346:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787790875.163840:0:15346:0:(import.c:65:import_set_state_nolock()) ffff9170f530d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787790875.164434:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787790875.164440:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1787790875.164493:0:15346:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787790875.164559:0:15346:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787790875.164583:0:15346:0:(import.c:65:import_set_state_nolock()) ffff9170f67a6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787790875.164601:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787790875.164603:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1787790875.164611:0:15346:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787790875.164677:0:15346:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787790875.164685:0:15346:0:(import.c:65:import_set_state_nolock()) ffff916fc31fa000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787790875.164928:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9170facf0000) has no exports 00000100:00100000:1.0:1787790875.165917:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268111360:0@lo:9:umount.0 00000100:00100000:1.0:1787790875.165992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790875.166033:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268111488:0@lo:9:umount.0 00000100:00100000:1.0:1787790875.166056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787790875.166111:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1787790875.166150:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268111360 00000100:00100000:3.0:1787790875.166157:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268111360 00000100:00100000:3.0:1787790875.166209:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268111488 00000100:00100000:3.0:1787790875.166213:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268111488 00000100:00100000:3.0:1787790875.166242:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790875.166250:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874634268111360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787790875.166276:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d81a 00000100:00080000:3.0:1787790875.166284:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9170f6779800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790875.166330:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787790875.166461:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3637:x1874634268111360:12345-0@lo:9:umount.0 Request processed in 212us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.166469:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787790875.166485:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787790875.166491:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874634268111488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787790875.166503:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d95c 00000100:00080000:3.0:1787790875.166508:0:8427:0:(import.c:65:import_set_state_nolock()) ffff916fc1cf6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787790875.166529:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787790875.166604:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3637:x1874634268111488:12345-0@lo:9:umount.0 Request processed in 112us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790875.166610:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787790875.166627:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787790875.166635:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787790875.166656:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67a6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787790875.166666:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787790875.166668:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787790875.166671:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268111360:0@lo:9:umount.0 00000100:00080000:3.0:1787790875.166683:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc31fa000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787790875.166686:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787790875.166723:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787790875.166727:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268111488:0@lo:9:umount.0 00000100:00100000:2.0:1787790875.168000:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1874634268110720:12345-0@lo:103:ldlm_bl.0 Request processed in 6781us (7797us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787790875.168010:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1787790875.171672:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790875.171729:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787790875.190174:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.122@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787790875.190180:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787790875.190188:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc458b0c0 x1874634268109568/t0(0) o400->MGC192.168.202.122@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787790887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790875.190269:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe8a1c0 x1874634268110720/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790875.190280:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe88b40 x1874634268110848/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790891 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790875.190301:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe8bc00 x1874634268111232/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790875.190311:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe883c0 x1874634268110976/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790891 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790875.190320:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe88000 x1874634268111104/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787790891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787790875.190328:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787790875.190331:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787790875.190333:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787790875.190366:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9170ceb1e000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787790875.190393:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268110976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790875.190420:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a75db525-924f-489b-b982-1d04f64567fb:3638:1874634268111104:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787790875.190558:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9170ceb1e000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787790875.190570:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a75db525-924f-489b-b982-1d04f64567fb:3639:1874634268109568:0@lo:400:kworker.0 00000100:00100000:3.0:1787790875.190594:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a75db525-924f-489b-b982-1d04f64567fb:3640:1874634268110720:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787790875.190623:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790875.190628:0:3641:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 181 00000100:00080000:0.0:1787790875.190636:0:3641:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170ceb1e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790875.190743:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4596580 x1874634268111616/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790875.191510:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268110848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790875.191523:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a75db525-924f-489b-b982-1d04f64567fb:3641:1874634268111232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790875.191563:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634268111616:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1787790875.191601:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268111616 offset 0 length 520: 4 00000020:00080000:2.0:1787790875.194060:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9170facf0000) has no exports 00000020:01000000:3.0:1787790875.247733:0:15346:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc302eb40 - data ffff916fc2046510/ffff916fc3039800 00000020:01000000:3.0:1787790875.247921:0:15346:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170f3d96ae0 - data ffff9170d69c2948/ffff9170f3da8000 00000001:00000004:1.0:1787790875.256488:0:15346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787790875.304592:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790875.304603:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787790875.304614:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787790875.311826:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787790875.311835:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787790875.311857:0:15346:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787790875.311860:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787790875.312197:0:8630:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787790875.312204:0:8630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787790875.312289:0:8630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787790875.313156:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787790875.313161:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787790875.313180:0:15346:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787790875.313182:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787790875.313541:0:9988:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787790875.313546:0:9988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787790875.313553:0:9988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787790875.315346:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d637 00000020:00000080:2.0:1787790875.315361:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170facfe000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787790875.317366:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d64c 00000020:00000080:2.0:1787790875.317377:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170facf8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790875.317647:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facfe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787790875.317818:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787790875.317824:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790875.317832:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787790875.317836:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9170facf19b8) has no exports 00000004:01000000:2.0:1787790875.318004:0:15346:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787790875.318019:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d955 00000020:00000080:2.0:1787790875.318025:0:15346:0:(genops.c:885:class_export_put()) final put ffff916fc1c8b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790875.318132:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facf8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787790875.318596:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787790875.318600:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790875.318608:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787790875.318611:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9170fbeeb370) has no exports 00000020:00000080:2.0:1787790875.318617:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d94e 00000020:00000080:2.0:1787790875.318621:0:15346:0:(genops.c:885:class_export_put()) final put ffff916fc31ff800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787790875.318840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1c8b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787790875.318847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc31ff800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787790875.319196:0:15346:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787790875.319202:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787790875.319206:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1787790875.319211:0:15346:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787790875.319213:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790875.319350:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790875.319358:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787790875.319365:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d813 00000020:00000080:2.0:1787790875.319369:0:15346:0:(genops.c:885:class_export_put()) final put ffff916fc2419000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790875.319893:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc31fa000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787790875.319902:0:8:0:(genops.c:885:class_export_put()) final put ffff916fc31fb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790875.319904:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc31fb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787790875.319910:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787790875.320118:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787790875.320175:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc2419000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787790875.320295:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790875.320303:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787790875.320306:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9170fbee8000) has no exports 00000020:00000080:3.0:1787790875.320313:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d80c 00000020:00000080:3.0:1787790875.320444:0:15346:0:(genops.c:885:class_export_put()) final put ffff916fc1d21000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787790875.321361:0:15346:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787790875.321367:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787790875.321370:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1787790875.321376:0:15346:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787790875.321377:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787790875.323876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1d21000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787790875.324975:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790875.324993:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787790875.325013:0:15346:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787790875.325023:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d6ae 00000020:00000080:3.0:1787790875.325042:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170ce9b1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787790875.325049:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787790875.325056:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790875.325061:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787790875.325065:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9170f52f99b8) has no exports 00000020:00000080:3.0:1787790875.325072:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d6a7 00000020:00000080:3.0:1787790875.325076:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170f530d000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787790875.325988:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f67a6800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787790875.326000:0:8:0:(genops.c:885:class_export_put()) final put ffff916fc1d25800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790875.326002:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1d25800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787790875.326009:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787790875.326104:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ce9b1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787790875.326110:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f530d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787790875.331875:0:15346:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787790875.331893:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787790875.331898:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787790875.331906:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790875.331973:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790875.331985:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787790875.332013:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790875.332016:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787790875.332022:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170f3eb9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787790875.332036:0:15346:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3eb9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787790875.332046:0:15346:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787790875.332204:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d653 00000020:00000080:2.0:1787790875.332210:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170facf8000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787790875.334195:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787790875.334201:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790875.334210:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787790875.334227:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9170facf4d28) has no exports 00000020:00000080:2.0:1787790875.334257:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790875.334313:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787790875.334328:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d65a 00000020:00000080:2.0:1787790875.334336:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170facf9000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787790875.334345:0:15346:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f3e20800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787790875.334348:0:15346:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f3e20800 2 00000020:01000004:2.0:1787790875.334352:0:15346:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170f3e20800 from lustre-MDT0001 00000020:00000080:2.0:1787790875.334371:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790875.334375:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787790875.334377:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170facf9800/lustre-MDT0001_UUID 00000020:00000080:2.0:1787790875.334380:0:15346:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facf9800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787790875.334388:0:15346:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787790875.334455:0:15346:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787790875.334459:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787790875.334462:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790875.334465:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787790875.334472:0:15346:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9170fbd31800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787790875.334478:0:15346:0:(genops.c:1553:class_disconnect_exports()) OBD device 15 (ffff9170f52f8000) has exports, disconnecting them 00000020:00080000:2.0:1787790875.334482:0:15346:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9170fbd31800), last request at 1787790649 00000020:00000080:2.0:1787790875.334486:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d6ed 00000020:00080000:2.0:1787790875.334501:0:15346:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170fbd31800): rc 0 00000020:00000080:2.0:1787790875.334504:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170fbd31800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787790875.335476:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f530d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787790875.335487:0:8:0:(genops.c:885:class_export_put()) final put ffff9170ce9b0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787790875.335490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ce9b0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1787790875.335497:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787790875.335629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facf8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1787790875.335633:0:8:0:(genops.c:885:class_export_put()) final put ffff9170facff800/lustre-MDD0001_UUID 00000020:00000080:0.0:1787790875.335636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facff800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1787790875.335639:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1787790875.335841:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facf9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787790875.335846:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170fbd31800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1787790875.344797:0:15346:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1787790875.344808:0:15346:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787790875.344812:0:15346:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787790875.344820:0:15346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787790875.344854:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170fbd33800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787790875.345066:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787790875.345076:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1787790875.345081:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170fbd32000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1787790875.345085:0:15346:0:(genops.c:844:class_export_destroy()) destroying export ffff9170fbd32000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1787790875.345095:0:15346:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1787790875.345174:0:15346:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f3e20800 1 00000020:00000080:0.0:1787790875.345181:0:15346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d5ea 00000020:00000080:0.0:1787790875.345189:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170f3ebc000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1787790875.345199:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1787790875.345207:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3ebc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787790875.345227:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787790875.345232:0:15346:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787790875.345236:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9170eef53370) has no exports 00000020:00000080:3.0:1787790875.404251:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790875.404280:0:15346:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787790875.404287:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170f3e23000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787790875.404293:0:15346:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3e23000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787790875.404306:0:15346:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787790875.404426:0:15346:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170f3e27800 00000020:01000000:3.0:1787790875.404446:0:15346:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787790875.404449:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790875.404454:0:15346:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787790875.404458:0:15346:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9170d63819b8) has no exports 00000100:00100000:0.0:1787790875.404790:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9170d63b8e00:6512] 0 exiting: rc = 1 00000100:00100000:0.0:1787790875.404935:0:10094:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff916fc3743600:10094] 4 exiting: rc = 0 00000100:00100000:0.0:1787790875.405018:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff917101199a00:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1787790875.405112:0:10093:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff916fc26c2a00:10093] 3 exiting: rc = 0 00000100:00100000:2.0:1787790875.405554:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91710119d400:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1787790875.406208:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406304:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406311:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406333:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406340:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406345:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406368:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406395:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406403:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406410:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406416:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406432:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406438:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406444:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406457:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406463:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406468:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406474:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406487:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406493:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406499:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406505:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406518:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406524:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406530:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406557:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406563:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406569:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406574:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406585:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406591:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406596:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406600:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406611:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406617:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406622:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406628:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406633:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406638:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406649:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406655:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406661:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406666:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406671:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406683:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406689:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406694:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.406700:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407001:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407008:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407020:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407107:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407116:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407121:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407126:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407140:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407146:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407152:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407157:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407169:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407185:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407197:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407203:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.407208:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790875.415094:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9170d16cf800:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1787790875.415420:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff917101144600:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1787790875.415566:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415576:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415583:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415589:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415595:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415601:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415609:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415615:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415620:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415624:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415629:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415635:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415641:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415645:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415650:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415655:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415660:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415665:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415670:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415675:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415679:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415685:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415690:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415696:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415701:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415812:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415818:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415825:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415831:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415837:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415844:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415872:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415878:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415893:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415899:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415904:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415910:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415915:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415920:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415926:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415931:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415936:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415942:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415947:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415953:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415958:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415965:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415971:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415977:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415983:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415989:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.415995:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416000:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416006:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416012:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416017:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416023:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416040:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416045:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416049:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416054:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416060:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416066:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.416072:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.417471:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9170cfc51400:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1787790875.417816:0:7807:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9170fbc57000:7807] 2 exiting: rc = 0 00000100:00100000:2.0:1787790875.417909:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9170cfc50200:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1787790875.418013:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418049:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418069:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418085:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418094:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418100:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418109:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418115:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418122:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418128:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418135:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418141:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418148:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418155:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418166:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418189:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418196:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418203:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418210:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418382:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418392:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418398:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418404:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418411:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418418:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418423:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418429:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418451:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418460:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418466:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418472:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418478:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418486:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418492:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418498:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418503:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418509:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418524:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418530:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418549:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418556:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418562:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418567:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418573:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418579:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418584:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418594:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418600:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418605:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418610:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418616:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418635:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418644:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418650:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418656:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418662:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418667:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418675:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418683:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418689:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418695:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418701:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418744:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.418761:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790875.431018:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9170df066200:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1787790875.431413:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9170c2e69800:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1787790875.431700:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431738:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431744:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431750:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431755:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431761:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431766:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431771:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431785:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431790:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431796:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431801:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431806:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431811:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431816:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431822:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431826:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431832:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431837:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431841:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431846:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431851:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431855:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431861:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431867:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431872:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431876:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431893:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431900:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431905:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431910:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431916:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431921:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431926:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431933:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431938:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431944:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431949:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431955:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431960:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431965:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431971:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431977:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431991:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.431997:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432002:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432008:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432013:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432018:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432164:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432175:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432180:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432185:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432190:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432195:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432201:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432206:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432211:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432216:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432297:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432303:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432308:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432313:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.432327:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.433583:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9170c87b4200:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1787790875.433937:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9170c2e68600:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1787790875.434056:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434065:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434070:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434076:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434081:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434087:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434092:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434097:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434103:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434108:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434113:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434119:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434124:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434129:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434147:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434153:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434158:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434163:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434169:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434174:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434182:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434187:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434192:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434197:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434202:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434207:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434212:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434429:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434438:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434443:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434448:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434453:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434458:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434462:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434468:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434473:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434478:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434483:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434488:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434493:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434498:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434504:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434509:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434515:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434521:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434527:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434532:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434537:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434542:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434554:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434559:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434564:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434569:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434574:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434579:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434583:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434588:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434593:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434598:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434602:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434607:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434611:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434616:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.434621:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790875.437610:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9170c6938000:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787790875.437822:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9170e45c9c00:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1787790875.437926:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437934:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437939:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437944:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437950:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437955:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437961:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437967:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437973:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437979:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437985:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437989:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437993:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.437999:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438006:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438010:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438014:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438019:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438024:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438041:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438062:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438067:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438073:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438077:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438082:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438087:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438092:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438096:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438101:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438106:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438111:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438116:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438120:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438125:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438130:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438134:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438138:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438144:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438148:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438153:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438158:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438162:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438167:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438172:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438176:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438181:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438186:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438190:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438196:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438200:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438204:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438209:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438213:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438445:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438450:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438463:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438468:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438473:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438478:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438484:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438490:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438496:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438502:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.438507:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790875.439408:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff917101140800:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1787790875.439828:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9170c3483e00:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1787790875.440018:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff917101152e00:6527] 2 exiting: rc = 0 00000100:00100000:0.0:1787790875.440194:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440204:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440210:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440228:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440235:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440241:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440246:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440265:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440272:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440277:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440283:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440288:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440293:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440299:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440306:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440311:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440317:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440323:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440329:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440334:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440338:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440344:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440349:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440354:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440360:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440365:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440382:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440388:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440394:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440400:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440406:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440425:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440433:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440440:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440446:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440452:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440458:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440466:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440472:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440478:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440483:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440489:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440496:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440501:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440508:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440513:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440520:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440526:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440530:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440537:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440543:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440548:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440553:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440559:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440564:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440585:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440591:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440597:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440603:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440609:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440614:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440627:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440632:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787790875.440638:0:15346:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787790875.447211:0:15346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787790875.447307:0:15346:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787790875.447313:0:15346:0:(genops.c:885:class_export_put()) final put ffff9170ceb1f000/MDS_uuid 00000020:00000080:0.0:1787790875.447319:0:15346:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb1f000/MDS_uuid for MDS 00000020:01000000:0.0:1787790875.447327:0:15346:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787790875.447515:0:15346:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787790875.470870:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790876.494994:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787790877.003202:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787790877.003216:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787790877.003220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787790877.003224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787790877.003229:0:8:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790877.003241:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1787790877.003259:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787790877.003270:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc2418000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790877.003340:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5aed00 x1874634268111744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790877.003425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787790877.003430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787790877.003432:0:8:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790877.003437:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1787790877.003440:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787790877.003463:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc344f000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790877.003474:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790877.003495:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268111872:0@lo:400:kworker.0 00000400:00000100:3.0:1787790877.003576:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268111872 offset 0 length 224: 4 00000100:00100000:3.0:1787790877.003682:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ade00 x1874634268112000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790877.003750:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787790877.003760:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268112128:0@lo:400:kworker.0 00000400:00000100:3.0:1787790877.003783:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112128 offset 0 length 224: 4 00000100:00100000:1.0:1787790877.004225:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268111744:0@lo:38:kworker.0 00000400:00000100:1.0:1787790877.004257:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268111744 offset 0 length 520: 4 00000100:00100000:1.0:1787790877.004276:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268112000:0@lo:38:kworker.0 00000400:00000100:1.0:1787790877.004308:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112000 offset 0 length 520: 4 00010000:00010000:2.0:1787790877.517250:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790878.538917:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787790879.508525:0:15547:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787790879.519403:0:15547:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787790879.519483:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790879.519502:0:15547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790879.519512:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790879.519520:0:15547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790879.519675:0:15547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787790879.519684:0:15547:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787790879.519748:0:15547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787790879.519763:0:15547:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5aed00 x1874634268111744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787790897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790879.519782:0:15547:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787790879.519789:0:15547:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787790879.519797:0:15547:0:(import.c:65:import_set_state_nolock()) ffff916fc2418000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787790879.519802:0:15547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787790879.519806:0:15547:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5aed00 x1874634268111744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787790897 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790879.519813:0:15547:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787790879.519817:0:15547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1787790879.519916:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268111744:0@lo:38:kworker.0 00000100:00080000:1.0:1787790879.522193:0:15547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787790879.522233:0:15547:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5ac3c0 x1874634268111872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790879.522381:0:15547:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787790879.522388:0:15547:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787790879.522423:0:15547:0:(import.c:65:import_set_state_nolock()) ffff9170f6779000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787790879.522666:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790879.522678:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790879.522690:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd39200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790879.522695:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790879.529311:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790879.529338:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790879.529346:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790879.529349:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787790879.529354:0:9514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787790879.529374:0:9514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:2.0:1787790879.529379:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790879.529389:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd39200/0xcf9477fddcf1da27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790879.529407:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790879.529432:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790879.529435:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790879.530598:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268111872:0@lo:400:kworker.0 00000100:00100000:3.0:1787790879.530670:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268112256:0@lo:39:umount.0 00000400:00000100:3.0:1787790879.530778:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112256 offset 0 length 224: 4 00010000:00010000:2.0:1787790879.563167:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790880.588803:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787790881.035701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787790881.035751:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790881.035755:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787790881.035759:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787790881.036074:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790881.036108:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268112384:0@lo:400:kworker.0 00000400:00000100:1.0:1787790881.036197:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112384 offset 0 length 224: 4 00000001:00100000:2.0:1787790881.101601:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787790881.101612:0:9504:0:(genops.c:885:class_export_put()) final put ffff916fc1cf0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787790881.101666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1cf0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787790881.101729:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1cf6800 for lustre-OST0001 00000001:00100000:1.0:1787790881.105077:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787790881.105090:0:8420:0:(genops.c:885:class_export_put()) final put ffff9170f677b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787790881.105171:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f677b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787790881.105224:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f6779800 for lustre-OST0000 00010000:00010000:2.0:1787790881.611163:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787790882.058975:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787790882.058987:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787790882.058991:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787790882.058994:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787790882.059239:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268112512:0@lo:400:kworker.0 00000400:00000100:0.0:1787790882.059309:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112512 offset 0 length 224: 4 00010000:00010000:2.0:1787790882.634954:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790883.658862:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790884.689910:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790885.706905:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790885.707065:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790875/real 1787790875] req@ffff916fc4596580 x1874634268111616/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787790885 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790885.707098:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc4596580 x1874634268111616/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787790885 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790885.707118:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790885.707135:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787790885.707139:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634268111616:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787790885.708692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787790885.708702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787790885.708717:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790885.708724:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 424 00000100:00080000:0.0:1787790885.708732:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787790885.708739:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170ceb1e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790885.708775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4596580 x1874634268112640/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790885.708807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787790885.708811:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787790885.709069:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790885.709087:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268112768:0@lo:400:kworker.0 00000100:00100000:1.0:1787790885.709089:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634268112640:0@lo:250:kworker.0 00000400:00000100:1.0:1787790885.712467:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268112640 offset 0 length 520: 4 00000400:00000100:3.0:1787790885.718299:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112768 offset 0 length 224: 4 00010000:00010000:2.0:1787790886.730882:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790887.754872:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790888.778871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790889.802874:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790889.803552:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790879/real 1787790879] req@ffff9170fbebd2c0 x1874634268112256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787790889 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790889.803584:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170fbebd2c0 x1874634268112256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787790889 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790889.803604:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f6779000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787790889.803648:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268112256:0@lo:39:umount.0 00000100:00080000:0.0:1787790889.803782:0:15547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787790889.803792:0:15547:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787790889.803797:0:15547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787790889.804847:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.804863:0:15547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.804870:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.804876:0:15547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.804967:0:15547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790889.804977:0:15547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.804984:0:15547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.804990:0:15547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790889.805064:0:15547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805094:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790889.805101:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805108:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fa00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790889.805112:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805120:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790889.805126:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790889.805146:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790889.805149:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787790889.805160:0:9514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:2.0:1787790889.805164:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805170:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1da35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805185:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790889.805188:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805193:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790889.805195:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805201:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790889.805207:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790889.805211:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787790889.805213:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787790889.805217:0:9514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:2.0:1787790889.805219:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790889.805236:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790889.805238:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790889.805240:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790889.808052:0:15547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787790889.808070:0:15547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f800/0xcf9477fddcf1dcb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1dcc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790889.808118:0:15547:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787790889.808127:0:15547:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787790889.808131:0:15547:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787790889.808172:0:15547:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787790889.808176:0:15547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787790889.808192:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787790889.808198:0:15547:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787790889.808201:0:15547:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9170eef319b8) has no exports 00000020:00080000:0.0:1787790889.808226:0:15547:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9170eef319b8) has no exports 00010000:00010000:2.0:1787790889.808667:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787790889.815882:0:15547:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170c353d3c0 - data ffff916fc200f000/ffff9170cea60c00 00000020:01000000:0.0:1787790889.816083:0:15547:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc10f8b40 - data ffff9170d6abb510/ffff9170fbee2800 00100000:10000000:0.0:1787790889.830289:0:15547:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787790889.850136:0:15547:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d787 00000020:00000080:1.0:1787790889.850428:0:15547:0:(genops.c:885:class_export_put()) final put ffff916fc1d5d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787790889.850456:0:15547:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f3c78800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787790889.850460:0:15547:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f3c78800 2 00000020:01000004:1.0:1787790889.850464:0:15547:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170f3c78800 from lustre-OST0000 00000020:00000080:1.0:1787790889.850487:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790889.850497:0:15547:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787790889.850501:0:15547:0:(genops.c:885:class_export_put()) final put ffff916fc1d5e000/lustre-OST0000_UUID 00000020:00000080:1.0:1787790889.850504:0:15547:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1d5e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787790889.850511:0:15547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1787790889.850567:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1d5d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1787790889.850591:0:15547:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787790889.850605:0:15547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787790889.850609:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790889.850614:0:15547:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787790889.850622:0:15547:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff916fc2419800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790889.850627:0:15547:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9170fc130000) has exports, disconnecting them 00000020:00080000:1.0:1787790889.850633:0:15547:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff916fc2419800), last request at 1787790666 00000020:00000080:1.0:1787790889.850637:0:15547:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d7b1 00000020:00080000:1.0:1787790889.850647:0:15547:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc2419800): rc 0 00000020:00000080:1.0:1787790889.850652:0:15547:0:(genops.c:885:class_export_put()) final put ffff916fc2419800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787790889.850691:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc2419800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787790889.851889:0:15547:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787790889.851895:0:15547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787790889.851907:0:15547:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787790889.851912:0:15547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787790889.852053:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787790889.852060:0:15547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787790889.852065:0:15547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787790889.852069:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787790889.852072:0:15547:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787790889.852078:0:15547:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff916fc241b000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787790889.852083:0:15547:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9170f52fcd28) has exports, disconnecting them 00000020:00080000:0.0:1787790889.852086:0:15547:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff916fc241b000), last request at 1787790666 00000020:00000080:0.0:1787790889.852090:0:15547:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d7c6 00000020:00080000:0.0:1787790889.852104:0:15547:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc241b000): rc 0 00000020:00000080:0.0:1787790889.852107:0:15547:0:(genops.c:885:class_export_put()) final put ffff916fc241b000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787790889.852514:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc2418000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787790889.852524:0:37:0:(genops.c:885:class_export_put()) final put ffff916fc1cf6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787790889.852527:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1cf6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787790889.852532:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787790889.852596:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc241b000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787790889.862825:0:15547:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787790889.862855:0:15547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787790889.862860:0:15547:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787790889.862867:0:15547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787790889.863093:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787790889.863102:0:15547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787790889.863108:0:15547:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f3c78800 1 00000020:00000080:0.0:1787790889.863115:0:15547:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d74f 00000020:00000080:0.0:1787790889.863123:0:15547:0:(genops.c:885:class_export_put()) final put ffff9170f5039000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787790889.863129:0:15547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787790889.863132:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787790889.863136:0:15547:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787790889.863139:0:15547:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9170facf3370) has no exports 00000020:00000080:2.0:1787790889.923462:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f6779000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787790889.923478:0:37:0:(genops.c:885:class_export_put()) final put ffff9170f677c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787790889.923483:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f677c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787790889.923634:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787790889.925457:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f5039000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787790889.957034:0:15547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790889.957050:0:15547:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787790889.957056:0:15547:0:(genops.c:885:class_export_put()) final put ffff9170f3ebe000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787790889.957062:0:15547:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3ebe000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787790889.957074:0:15547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787790889.957203:0:15547:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170f3c7c800 00000020:02000400:1.0:1787790889.957257:0:15547:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1787790890.826906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787790890.826925:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790890.826928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787790890.826931:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787790890.826996:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268112896:0@lo:400:kworker.0 00000400:00000100:1.0:1787790890.827049:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268112896 offset 0 length 224: 4 00010000:00010000:2.0:1787790890.827327:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790891.852080:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790892.874963:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787790893.309241:0:15749:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787790893.323972:0:15749:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787790893.324093:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790893.324113:0:15749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790893.324123:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790893.324133:0:15749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790893.324170:0:15749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787790893.324178:0:15749:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787790893.324222:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787790893.324238:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5ade00 x1874634268112000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787790897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.324276:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787790893.324286:0:15749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787790893.324297:0:15749:0:(import.c:65:import_set_state_nolock()) ffff916fc344f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787790893.324325:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787790893.324330:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5ade00 x1874634268112000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787790897 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.324339:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787790893.324343:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1787790893.324464:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268112000:0@lo:38:kworker.0 00000100:00080000:1.0:1787790893.325504:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787790893.325517:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5ada40 x1874634268112128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.325535:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc4595a40 x1874634268112384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.325554:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170ff5ac3c0 x1874634268112512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.325569:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc45961c0 x1874634268112768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790901 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.325578:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbebc000 x1874634268112896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790906 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790893.325586:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787790893.325591:0:15749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787790893.325621:0:15749:0:(import.c:65:import_set_state_nolock()) ffff916fc344c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787790893.325772:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268112128:0@lo:400:kworker.0 00000100:00100000:3.0:1787790893.325811:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268112768:0@lo:400:kworker.0 00000100:00100000:3.0:1787790893.325821:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268112512:0@lo:400:kworker.0 00000100:00100000:3.0:1787790893.325878:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268113024:0@lo:39:umount.0 00000400:00000100:3.0:1787790893.325941:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268113024 offset 0 length 224: 4 00010000:00010000:2.0:1787790893.326089:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790893.326101:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790893.326112:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790893.326117:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790893.326143:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790893.326151:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790893.326157:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790893.326160:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787790893.326163:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787790893.326181:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:2.0:1787790893.326185:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790893.326192:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1da0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790893.326206:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790893.326207:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790893.326209:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790893.326486:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268112896:0@lo:400:kworker.0 00000100:00100000:0.0:1787790893.326494:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268112384:0@lo:400:kworker.0 00010000:00010000:2.0:1787790893.899148:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790894.922941:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790895.947212:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790895.947644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790895.947653:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787790896.971849:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790897.994990:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790899.021632:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790900.042866:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790900.490845:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790885/real 1787790885] req@ffff916fc4596580 x1874634268112640/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787790900 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790900.490885:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc4596580 x1874634268112640/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787790900 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787790900.490907:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790900.490934:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787790900.490938:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634268112640:0@lo:250:kworker.0 00000100:00080000:2.0:1787790900.491119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a75db525-924f-489b-b982-1d04f64567fb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787790900.491139:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787790900.491142:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790900.491147:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1787790900.491152:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.122@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787790900.491159:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170ceb1e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790900.491188:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe8a940 x1874634268113152/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790900.491243:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634268113152:0@lo:250:kworker.0 00000400:00000100:3.0:1787790900.491286:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268113152 offset 0 length 520: 4 00010000:00010000:2.0:1787790901.066946:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790902.090899:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790903.118470:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790903.562836:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790893/real 1787790893] req@ffff9170fbebc780 x1874634268113024/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787790903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790903.562870:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170fbebc780 x1874634268113024/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787790903 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787790903.562891:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc344c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787790903.562914:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268113024:0@lo:39:umount.0 00000100:00080000:1.0:1787790903.563002:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787790903.563007:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787790903.563013:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787790903.564013:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564030:0:15749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564056:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564063:0:15749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564093:0:15749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790903.564101:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564108:0:15749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564114:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564120:0:15749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.564153:0:15749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787790903.564157:0:15749:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787790903.564182:0:15749:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787790903.564186:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787790903.564190:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790903.564195:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787790903.564200:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff916fc320b370) has no exports 00000020:00080000:1.0:1787790903.564223:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff916fc320b370) has no exports 00000020:01000000:1.0:1787790903.566042:0:15749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc1f56300 - data ffff9170d6ad7d80/ffff9170cea60400 00000020:01000000:1.0:1787790903.566164:0:15749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc3324d80 - data ffff9170d6ab8438/ffff9170f676ac00 00010000:00010000:2.0:1787790903.566551:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790903.566560:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566571:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790903.566575:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566585:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790903.566593:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790903.566599:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787790903.566602:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787790903.566604:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787790903.566618:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:2.0:1787790903.566621:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566646:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1da19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da20 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566657:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790903.566661:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566667:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790903.566670:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566677:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790903.566683:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790903.566688:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787790903.566690:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787790903.566692:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787790903.566697:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:2.0:1787790903.566699:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566754:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3995c00/0xcf9477fddcf1dcab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1dcb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790903.566767:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790903.566768:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790903.566775:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790903.567051:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787790903.574281:0:15749:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787790903.580338:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d8ad 00000020:00000080:1.0:1787790903.580353:0:15749:0:(genops.c:885:class_export_put()) final put ffff916fc3200000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787790903.580366:0:15749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f67a4800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787790903.580370:0:15749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67a4800 2 00000020:01000004:1.0:1787790903.580373:0:15749:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170f67a4800 from lustre-OST0001 00000020:00000080:1.0:1787790903.580400:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790903.580410:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787790903.580414:0:15749:0:(genops.c:885:class_export_put()) final put ffff916fc3202000/lustre-OST0001_UUID 00000020:00000080:1.0:1787790903.580417:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3202000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787790903.580425:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787790903.580543:0:15749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a75db525-924f-489b-b982-1d04f64567fb->MGS 00010000:00010000:1.0:1787790903.580559:0:15749:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c29e1200/0xcf9477fddcf1d606 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790903.580571:0:15749:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c29e1200/0xcf9477fddcf1d606 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790903.580578:0:15749:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787790903.580581:0:15749:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787790903.580584:0:15749:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787790903.580598:0:15749:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:1.0:1787790903.580602:0:15749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c29e1200/0xcf9477fddcf1d606 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1d60d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790903.580618:0:15749:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787790903.580734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3200000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:1.0:1787790903.580857:0:15749:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790903.580945:0:15749:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787790903.580948:0:15749:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787790903.580950:0:15749:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787790903.580964:0:15749:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170ceb1e000 00010000:00010000:1.0:1787790903.580968:0:15749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c0030800/0xcf9477fddcf1da7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1da82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787790903.580985:0:15749:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787790903.580990:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787790903.580992:0:15749:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787790903.580993:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787790903.580997:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787790903.581008:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe8a940 x1874634268113152/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787790920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787790903.581152:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787790903.581155:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1787790903.581385:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a75db525-924f-489b-b982-1d04f64567fb:3637:1874634268113152:0@lo:250:kworker.0 10000000:01000000:1.0:1787790903.581451:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787790903.581460:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d503 00000020:00000080:1.0:1787790903.581466:0:15749:0:(genops.c:885:class_export_put()) final put ffff9170ceb19800/a75db525-924f-489b-b982-1d04f64567fb 00000020:01000000:1.0:1787790903.581483:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.122@tcp (flags='') 00000020:00000080:1.0:1787790903.581488:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790903.581494:0:15749:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787790903.581498:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9170d6383370) has no exports 00000020:00000080:2.0:1787790903.581935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb19800/a75db525-924f-489b-b982-1d04f64567fb for MGC192.168.202.122@tcp 10000000:01000000:2.0:1787790903.581958:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787790903.582048:0:15749:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.122@tcp: client import never connected 00000100:00080000:1.0:1787790903.582051:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787790903.582053:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787790903.582054:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787790903.582056:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787790903.582094:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787790903.582099:0:15749:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.122@tcp (uuid a75db525-924f-489b-b982-1d04f64567fb) 00000020:01000000:1.0:1787790903.582104:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787790903.582115:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787790903.582120:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787790903.582124:0:15749:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff916fc344d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787790903.582129:0:15749:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff916fc34acd28) has exports, disconnecting them 00000020:00080000:1.0:1787790903.582133:0:15749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff916fc344d000), last request at 1787790683 00000020:00000080:1.0:1787790903.582137:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d8d7 00000020:00080000:1.0:1787790903.582146:0:15749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc344d000): rc 0 00000020:00000080:1.0:1787790903.582149:0:15749:0:(genops.c:885:class_export_put()) final put ffff916fc344d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787790903.582835:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ceb1e000 for MGC192.168.202.122@tcp 00000020:00000080:2.0:1787790903.582843:0:8:0:(genops.c:885:class_export_put()) final put ffff9170ceb19000/a75db525-924f-489b-b982-1d04f64567fb 00000020:00000080:2.0:1787790903.582846:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb19000/a75db525-924f-489b-b982-1d04f64567fb for MGC192.168.202.122@tcp 00000020:01000000:2.0:1787790903.582850:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.122@tcp (a75db525-924f-489b-b982-1d04f64567fb) 00000020:00000080:2.0:1787790903.583136:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc344d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787790903.583841:0:15749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787790903.583846:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787790903.583850:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787790903.583856:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787790903.584151:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790903.584158:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787790903.584163:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787790903.584169:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790903.584172:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787790903.584178:0:15749:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff916fc344b000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787790903.584183:0:15749:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff916fc34ab370) has exports, disconnecting them 00000020:00080000:3.0:1787790903.584187:0:15749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff916fc344b000), last request at 1787790683 00000020:00000080:3.0:1787790903.584191:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d8ec 00000020:00080000:3.0:1787790903.584203:0:15749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc344b000): rc 0 00000020:00000080:3.0:1787790903.584208:0:15749:0:(genops.c:885:class_export_put()) final put ffff916fc344b000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787790903.585307:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc344f000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787790903.585318:0:8:0:(genops.c:885:class_export_put()) final put ffff916fc3448000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787790903.585321:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3448000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787790903.585326:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787790903.585379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc344b000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787790903.585404:0:15749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787790903.585408:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787790903.585412:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787790903.585416:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787790903.585434:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc344c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787790903.585472:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787790903.585586:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787790903.585668:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787790903.585808:0:9513:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff916fc26c2e00:9513] 2 exiting: rc = 0 00000100:00100000:2.0:1787790903.585878:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9170d16ce400:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1787790903.585942:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9170d16ce800:6497] 1 exiting: rc = 0 00000100:00100000:2.0:1787790903.585997:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.586254:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9170ceaa1a00:6498] 0 exiting: rc = 1 00000100:00100000:2.0:1787790903.586325:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9170c4f87400:6499] 1 exiting: rc = 0 00000100:00100000:2.0:1787790903.608913:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9170d6137c00:6500] 2 exiting: rc = 0 00000100:00100000:2.0:1787790903.609040:0:8442:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff916fc1cfc400:8442] 3 exiting: rc = 0 00000100:00100000:3.0:1787790903.609292:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609302:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609307:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609312:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609317:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609324:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609329:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609336:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609341:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609347:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609352:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609357:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609362:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609368:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609374:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609380:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609386:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609407:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609413:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609420:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609426:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609431:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609436:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609442:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609447:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609451:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609457:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609463:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609467:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609472:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609477:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609481:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609486:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609491:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609496:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609511:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609516:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609522:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609526:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609531:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609535:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609540:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609544:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609549:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609554:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609558:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609563:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609567:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609572:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609576:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609581:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609586:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609597:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609603:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609607:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609612:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609616:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609621:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609625:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609643:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609648:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609654:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609659:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.609664:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787790903.611517:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787790903.611529:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787790903.611535:0:15749:0:(genops.c:885:class_export_put()) final put ffff916fc3448800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787790903.611539:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3448800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787790903.611550:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787790903.611602:0:15749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67a4800 1 00000020:00000080:3.0:1787790903.611607:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1d87c 00000020:00000080:3.0:1787790903.611613:0:15749:0:(genops.c:885:class_export_put()) final put ffff9170f677e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787790903.611642:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787790903.611646:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787790903.611652:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787790903.611656:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9170fbeecd28) has no exports 00000020:00000080:2.0:1787790903.615063:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f677e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787790903.669492:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790903.669518:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787790903.669524:0:15749:0:(genops.c:885:class_export_put()) final put ffff9170f67a0000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787790903.669528:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f67a0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787790903.669534:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787790903.669880:0:15749:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170f67a4000 00000020:01000000:2.0:1787790903.669900:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787790903.669905:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787790903.669909:0:15749:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787790903.669913:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9170fc1319b8) has no exports 00000020:00000080:2.0:1787790903.669933:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787790903.669938:0:15749:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787790903.669941:0:15749:0:(genops.c:885:class_export_put()) final put ffff9170f503c800/OSS_uuid 00000020:00000080:2.0:1787790903.669943:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f503c800/OSS_uuid for OSS 00000020:01000000:2.0:1787790903.669946:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787790903.670296:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787790903.673541:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9170eef73c00:8428] 2 exiting: rc = 0 00000100:00100000:3.0:1787790903.673651:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9170face6200:8426] 0 exiting: rc = 1 00000100:00100000:1.0:1787790903.674681:0:10092:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff916fc26c3a00:10092] 3 exiting: rc = 0 00000100:00100000:1.0:1787790903.675968:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9170fbe21200:8427] 1 exiting: rc = 0 00000100:00100000:3.0:1787790903.676104:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676114:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676120:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676151:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676159:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676164:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676181:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676186:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676193:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676199:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676206:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676212:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676217:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676222:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676227:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676233:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676238:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676243:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676247:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676252:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676257:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676261:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676267:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676272:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676277:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676283:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676288:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676292:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676297:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676302:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676307:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676312:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676317:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676322:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676327:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676332:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676337:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676342:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676346:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676351:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676357:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676370:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676375:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676380:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676386:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676392:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676397:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676402:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676408:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676413:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676418:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676424:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676429:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676435:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676440:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676445:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676451:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676456:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676462:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676467:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676472:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676477:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676482:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.676499:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.678482:0:10090:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff916fc26db400:10090] 2 exiting: rc = 0 00000100:00100000:2.0:1787790903.681493:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9170fbe21000:8430] 1 exiting: rc = 0 00000100:00100000:3.0:1787790903.683363:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9170fbe20000:8429] 0 exiting: rc = 1 00000100:00100000:1.0:1787790903.686294:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686307:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686314:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686319:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686325:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686331:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686338:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686343:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686348:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686353:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686358:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686362:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686368:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686373:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686379:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686384:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686390:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686395:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686400:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686406:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686411:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686436:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686443:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686448:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686453:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686458:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686463:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686468:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686474:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686478:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686483:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686488:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686494:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686499:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686517:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686523:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686528:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686534:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686540:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686545:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686549:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686555:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686561:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686566:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686571:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686577:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686582:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686586:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686592:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686598:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686603:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686609:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686614:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686620:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686625:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686863:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686876:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686882:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686886:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686891:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686896:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686901:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686907:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.686912:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.694083:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9170fbdbb600:8433] 2 exiting: rc = 0 00000100:00100000:1.0:1787790903.697930:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9170fbde3200:8431] 0 exiting: rc = 1 00000100:00100000:2.0:1787790903.698989:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9170fbdba200:8432] 1 exiting: rc = 0 00000100:00100000:1.0:1787790903.699329:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699338:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699343:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699349:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699354:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699360:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699366:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699371:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699386:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699393:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699399:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699405:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699411:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699417:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699424:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699430:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699437:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699443:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699449:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699455:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699462:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699468:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699474:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699480:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699486:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699491:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699509:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699514:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699519:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699524:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699529:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699535:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699557:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699564:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699569:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699575:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699580:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699586:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699591:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699597:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699602:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699608:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699614:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699619:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699641:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699648:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699654:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699659:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699665:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699671:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699677:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699683:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699688:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699694:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699700:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699721:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699727:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699733:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699739:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699744:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699750:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699764:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699777:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.699784:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787790903.703768:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9170fbde4400:8434] 0 exiting: rc = 1 00000100:00100000:0.0:1787790903.706689:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9170fbde4200:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1787790903.720769:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720937:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720942:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720948:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720953:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720960:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720966:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720972:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720977:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.720982:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721005:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721010:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721015:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721020:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721025:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721030:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721035:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721040:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721044:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721049:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721054:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721059:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721065:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721070:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721076:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721081:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721086:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721091:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721096:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721101:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721106:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721111:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721116:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721122:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721140:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721145:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721150:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721155:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721160:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721165:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721170:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721174:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721180:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721185:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721190:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721203:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721209:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721215:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721220:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721225:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721230:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721235:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721239:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721244:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721248:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721254:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721259:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721264:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721269:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721275:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721280:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721285:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721290:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.721456:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787790903.725954:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9170f3daee00:8436] 0 exiting: rc = 1 00000100:00100000:3.0:1787790903.726283:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9170f3daec00:8437] 1 exiting: rc = 0 00000100:00100000:2.0:1787790903.726580:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726599:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726642:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726652:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726659:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726666:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726672:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726679:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726693:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726699:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726748:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726762:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726768:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726845:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726872:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726879:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726899:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726905:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726912:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726920:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726926:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726933:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726939:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726945:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726952:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726959:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726980:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726988:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.726995:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727001:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727006:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727013:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727019:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727025:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727031:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727037:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727043:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727049:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727069:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727077:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727082:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727089:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727095:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727101:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727108:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727114:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727122:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727243:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727249:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727256:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727276:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727289:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727297:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727304:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727310:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727316:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727322:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727329:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727334:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727340:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727347:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727354:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727359:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787790903.727375:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787790903.742239:0:15749:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787790922.206064:0:16514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787790933.086387:0:17113:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787790933.086393:0:17113:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787790933.086395:0:17113:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787790933.086507:0:17113:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff916fc46e5000 00000020:01000004:1.0:1787790933.086529:0:17113:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787790933.086536:0:17113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787790933.086590:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff916fc320b370) 00000020:00000080:1.0:1787790933.086607:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787790933.175300:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787790933.185931:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787790933.189928:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787790933.194437:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787790933.196451:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1787790933.197035:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787790933.198533:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1787790933.199478:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.200661:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.201003:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.201214:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.201501:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.201830:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.202040:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.202242:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.202559:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.203756:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.203988:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.204175:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.204440:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.204893:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.205088:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.205288:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.206783:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.207178:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.207447:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.207793:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.208028:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.208575:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.209314:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.209560:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.209876:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787790933.210273:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.210490:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787790933.215372:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.218304:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787790933.219022:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.219287:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787790933.219574:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787790933.219997:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787790933.220188:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.220795:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787790933.221003:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.221184:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.221893:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787790933.224859:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.225167:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.226095:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.226571:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.226961:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.227391:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.227597:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787790933.227910:0:17113:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1787790933.228455:0:17113:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787790933.229010:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787790933.229018:0:17113:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787790933.229029:0:17113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eac0 00000020:01000004:1.0:1787790933.229035:0:17113:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787790933.229040:0:17113:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787790933.229044:0:17113:0:(tgt_mount.c:101:server_register_mount()) register mount ffff916fc46e5000 from MGS 00000020:01000004:1.0:1787790933.229048:0:17113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787790933.229057:0:17113:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff916fc32099b8) 00000020:00000080:1.0:1787790933.229066:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787790933.229120:0:17113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff916fc46e5000 from MGS, refs=2 00080000:01000000:1.0:1787790933.229125:0:17113:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787790933.229129:0:17113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eace 00000100:00100000:1.0:1787790933.229242:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787790933.229374:0:17113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787790933.229382:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787790933.229994:0:17113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787790933.230002:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787790933.230892:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790933.231066:0:17113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787790933.231072:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787790933.231948:0:17113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787790933.231956:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787790933.232313:0:17113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787790933.232319:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787790933.233294:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790933.233298:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790933.233300:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790933.233907:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790933.233911:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790933.233920:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790933.234411:0:17113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787790933.240403:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787790933.257728:0:17113:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787790933.273254:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787790933.274185:0:17113:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787790933.274252:0:17113:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787790933.277777:0:17113:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787790933.278104:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790933.278274:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787790933.278280:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787790933.281209:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787790933.281224:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787790933.281933:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787790933.281941:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787790933.282855:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787790933.282877:0:17113:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.122@tcp' 00000020:01000004:0.0:1787790933.282879:0:17113:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787790933.282910:0:17113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.122@tcp (typ=mgc) 00000020:00000080:0.0:1787790933.282924:0:17113:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.122@tcp (ffff9170fc134d28) 00000020:00000080:0.0:1787790933.282940:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787790933.283018:0:17113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170facf9800@MGC192.168.202.122@tcp: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787790933.283163:0:17113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.122@tcp-0 is initialized 00000040:01000000:0.0:1787790933.283168:0:17113:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787790933.283288:0:17130:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787790933.287812:0:17131:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787790933.287905:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.122@tcp (uuid 5041f1dd-aadb-4baa-80c4-90de68fcfbb8) 00000020:00000080:0.0:1787790933.287931:0:17113:0:(genops.c:1385:class_connect()) connect: client 5041f1dd-aadb-4baa-80c4-90de68fcfbb8, cookie 0xcf9477fddcf1eadc 00000100:00080000:0.0:1787790933.287947:0:17113:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790933.287954:0:17113:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170facf9800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790933.287988:0:17113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4597c00 x1874634268113280/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790933.288013:0:17113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS 00000020:01000004:0.0:1787790933.288037:0:17113:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787790933.288042:0:17113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787790933.288063:0:17113:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9170fc133370) 00000020:00000080:0.0:1787790933.288074:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787790933.288353:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268113280:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787790933.288436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.289003:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268113280 00000100:00100000:3.0:1787790933.289011:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268113280 00000100:00100000:3.0:1787790933.289042:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790933.289062:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1874634268113280:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787790933.289107:0:17127:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5041f1dd-aadb-4baa-80c4-90de68fcfbb8@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1787790933.289131:0:17127:0:(genops.c:1385:class_connect()) connect: client 5041f1dd-aadb-4baa-80c4-90de68fcfbb8, cookie 0xcf9477fddcf1eaea 00000100:00080000:3.0:1787790933.289258:0:17127:0:(import.c:65:import_set_state_nolock()) ffff9170c355a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790933.289318:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+5:3637:x1874634268113280:12345-0@lo:250:mount.lustre.0 Request processed in 255us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790933.289326:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790933.290036:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787790933.290058:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.122@tcp: connect to target with instance 0 00000100:00080000:2.0:1787790933.290076:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787790933.290081:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787790933.290085:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787790933.290088:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787790933.290099:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787790933.290105:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268113280:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787790933.325945:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790933.326155:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787790933.326162:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787790933.329994:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787790933.330007:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787790933.330340:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787790933.330346:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787790933.331375:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787790933.331568:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787790933.331573:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787790933.339220:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787790933.339245:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787790933.404200:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790933.404426:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787790933.404433:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787790933.406942:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787790933.406958:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787790933.407518:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790933.407943:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787790933.407950:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787790933.408337:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787790933.408343:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787790933.409249:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790933.409493:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787790933.409499:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787790933.410218:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787790933.410226:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787790933.411278:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790933.411939:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787790933.411945:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787790933.412493:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787790933.412501:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787790933.437183:0:17113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790933.437407:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787790933.437414:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787790933.443020:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787790933.443034:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787790933.449061:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787790933.451823:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787790933.456190:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787790933.456221:0:17113:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787790933.456227:0:17113:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787790933.456316:0:17113:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787790933.456345:0:17113:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787790933.456350:0:17113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787790933.456351:0:17113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787790933.456353:0:17113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790933.456354:0:17113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790933.456355:0:17113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790933.456357:0:17113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790933.456358:0:17113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790933.456359:0:17113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787790933.456361:0:17113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790933.456375:0:17113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787790933.456377:0:17113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787790933.456379:0:17113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787790933.456380:0:17113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787790933.456381:0:17113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790933.456382:0:17113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790933.456384:0:17113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790933.456385:0:17113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790933.456386:0:17113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790933.456391:0:17113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787790933.456392:0:17113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790933.456393:0:17113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787790933.456424:0:17113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787790933.456442:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787790933.456518:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790933.456554:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.456969:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268113408 00000100:00100000:0.0:1787790933.456981:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268113408 00000100:00100000:0.0:1787790933.457025:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790933.457034:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+5:17113:x1874634268113408:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787790933.457074:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787790933.457077:0:17129:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787790933.457080:0:17129:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787790933.459239:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787790933.459932:0:17129:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787790933.462473:0:17151:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787790933.462481:0:17151:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787790933.462484:0:17151:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787790933.462493:0:17151:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787790933.466888:0:17151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787790933.469954:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787790933.469968:0:17129:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787790933.478356:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+5:17113:x1874634268113408:12345-0@lo:253:mount.lustre.0 Request processed in 21313us (21837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.478385:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790933.478495:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787790933.478571:0:17113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787790933.478575:0:17113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790933.478577:0:17113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787790933.478578:0:17113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790933.478580:0:17113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790933.478693:0:17113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790933.478696:0:17113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790933.478697:0:17113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790933.478699:0:17113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787790933.478700:0:17113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790933.478861:0:17113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787790933.478884:0:17113:0:(tgt_mount.c:101:server_register_mount()) register mount ffff916fc46e5000 from lustre-MDT0000 10000000:01000000:2.0:1787790933.478913:0:17113:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787790933.478916:0:17113:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787790933.478921:0:17113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9170fc134d28 10000000:01000000:2.0:1787790933.478926:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787790933.478933:0:17113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9170fc134d28 from 1 10000000:01000000:2.0:1787790933.478936:0:17113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787790933.478976:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.478986:0:17113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.478997:0:17113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790933.479033:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790933.479071:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790933.479158:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097000 going to sleep for 11 seconds 00000100:00100000:3.0:1787790933.481798:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268113536 00000100:00100000:3.0:1787790933.481813:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268113536 00000100:00100000:3.0:1787790933.481880:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790933.481891:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+5:17113:x1874634268113536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790933.481908:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790933.481957:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539000/0xcf9477fddcf1eaf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1eaf1 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.481985:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539000/0xcf9477fddcf1eaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1eaf1 expref: 6 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.481997:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539000/0xcf9477fddcf1eaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eaf1 expref: 6 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.482005:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539000, rc 0) 00000100:00100000:3.0:1787790933.482087:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+6:17113:x1874634268113536:12345-0@lo:101:mount.lustre.0 Request processed in 198us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790933.482095:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790933.482418:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790933.482434:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.482441:0:17113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790933.482498:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790933.482528:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790933.482564:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097000 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.482618:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268113664 00000100:00100000:1.0:1787790933.482623:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268113664 00000100:00100000:1.0:1787790933.482660:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787790933.482667:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+6:17113:x1874634268113664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790933.482792:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+6:17113:x1874634268113664:12345-0@lo:501:mount.lustre.0 Request processed in 125us (263us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790933.482800:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790933.482883:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113664:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787790933.482910:0:17113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787790933.482921:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.482928:0:17113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790933.482936:0:17113:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff916fc46e5000 10000000:01000000:0.0:1787790933.482941:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787790933.482946:0:17113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff916fc46e5000 10000000:01000000:0.0:1787790933.482948:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787790933.482951:0:17113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff916fc46e5000 from 1 10000000:01000000:0.0:1787790933.482953:0:17113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787790933.482973:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.482980:0:17113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.482988:0:17113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790933.483013:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787790933.483039:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.483072:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0d943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790933.483131:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268113792 00000100:00100000:2.0:1787790933.483136:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268113792 00000100:00100000:2.0:1787790933.483164:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790933.483169:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+6:17113:x1874634268113792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790933.483175:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790933.483183:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994200/0xcf9477fddcf1eb06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1eaff expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.483194:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994200/0xcf9477fddcf1eb06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1eaff expref: 7 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.483200:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994200/0xcf9477fddcf1eb06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eaff expref: 7 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.483214:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994200, rc 0) 00000100:00100000:2.0:1787790933.483234:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+7:17113:x1874634268113792:12345-0@lo:101:mount.lustre.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790933.483238:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790933.483287:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790933.483295:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.483302:0:17113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790933.483314:0:17113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787790933.483318:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.483324:0:17113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790933.483329:0:17113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787790933.483332:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787790933.483336:0:17113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff916fc46e5000 10000000:01000000:0.0:1787790933.483339:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787790933.483342:0:17113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787790933.483344:0:17113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787790933.483357:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.483376:0:17113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.483389:0:17113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790933.483402:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787790933.483425:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.483444:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0d943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790933.483490:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268113920 00000100:00100000:2.0:1787790933.483494:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268113920 00000100:00100000:2.0:1787790933.483521:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790933.483527:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+7:17113:x1874634268113920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790933.483533:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790933.483540:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995e00/0xcf9477fddcf1eb14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1eb0d expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.483552:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995e00/0xcf9477fddcf1eb14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1eb0d expref: 8 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.483560:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995e00/0xcf9477fddcf1eb14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eb0d expref: 8 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.483566:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995e00, rc 0) 00000100:00100000:2.0:1787790933.483594:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+8:17113:x1874634268113920:12345-0@lo:101:mount.lustre.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790933.483600:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790933.483662:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268113920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790933.483673:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.483681:0:17113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790933.483755:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268114048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790933.483782:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.483803:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0d943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790933.483851:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268114048 00000100:00100000:2.0:1787790933.483855:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268114048 00000100:00100000:2.0:1787790933.483891:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790933.483897:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+8:17113:x1874634268114048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790933.484015:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17113:x1874634268114048:12345-0@lo:501:mount.lustre.0 Request processed in 117us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790933.484029:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787790933.484094:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268114048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790933.484121:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268114176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790933.484158:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.484178:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0d943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790933.484497:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268114176 00000100:00100000:2.0:1787790933.484502:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268114176 00000100:00100000:2.0:1787790933.484533:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790933.484540:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17113:x1874634268114176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790933.487845:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17113:x1874634268114176:12345-0@lo:503:mount.lustre.0 Request processed in 3295us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.487861:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790933.487997:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268114176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790933.488354:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17152:1874634268114304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790933.488424:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790933.488468:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e10979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.488889:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268114304 00000100:00100000:1.0:1787790933.488896:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268114304 00000100:00100000:1.0:1787790933.488943:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790933.488952:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17152:x1874634268114304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790933.490185:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17152:x1874634268114304:12345-0@lo:502:llog_process_th.0 Request processed in 1227us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.490197:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787790933.493634:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17152:1874634268114304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787790933.493687:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790933.493700:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790933.493729:0:17152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787790933.493736:0:17152:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787790933.493740:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790933.493756:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9170fbeecd28) 00000020:00000080:2.0:1787790933.493774:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787790933.493779:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787790933.493879:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787790933.493886:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eb22 00000020:00000080:2.0:1787790933.494102:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787790933.494107:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787790933.494111:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790933.494113:0:17152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787790933.494116:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787790933.494119:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787790933.494120:0:17152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787790933.494130:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787790933.494138:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9170fbee99b8) 00000020:00000080:2.0:1787790933.494147:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787790933.494151:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787790933.494153:0:17152:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787790933.494156:0:17152:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787790933.494161:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787790933.494204:0:17152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff916fc46e5000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787790933.494215:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9170fbee8000) 00000020:00000080:2.0:1787790933.494223:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787790933.494288:0:17152:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787790933.494294:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1eb37 00000020:00000080:2.0:1787790933.494394:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787790933.494400:0:17152:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787790933.494404:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf9477fddcf1eb3e 00080000:01000000:2.0:1787790933.494409:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787790933.494411:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eb45 00010000:00010000:2.0:1787790933.593081:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787790933.594044:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787790933.596040:0:17152:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787790933.596556:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9170fbeeb370) 00000020:00000080:2.0:1787790933.596575:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787790933.596666:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787790933.596674:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eb53 00000020:00000080:0.0:1787790933.604501:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787790933.616191:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf9477fddcf1eb5a 00000020:00000080:0.0:1787790933.621133:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787790933.621147:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790933.621155:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.621158:0:17152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787790933.621162:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787790933.621165:0:17152:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787790933.621167:0:17152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790933.621169:0:17152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790933.621170:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787790933.621173:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.621174:0:17152:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787790933.621177:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790933.621182:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.621184:0:17152:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787790933.621190:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787790933.621238:0:17152:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787790933.621258:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790933.621261:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.621263:0:17152:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787790933.621279:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790933.621282:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.621284:0:17152:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787790933.621287:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787790933.621292:0:17152:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:0.0:1787790933.621317:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787790933.621333:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9170fc1319b8) 00000020:00000080:0.0:1787790933.621351:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787790933.621355:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787790933.621428:0:17152:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787790933.621433:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787790933.621441:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eb68 00010000:00080000:0.0:1787790933.621884:0:17152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170eef42800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787790933.626004:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787790933.627414:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787790933.627430:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787790933.627478:0:17152:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787790933.627501:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1eb6f 00000100:00080000:3.0:1787790933.627521:0:17152:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790933.627527:0:17152:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9170eef42800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790933.627565:0:17152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ad680 x1874634268114432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790933.627606:0:17152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787790933.627671:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790933.627676:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.627678:0:17152:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787790933.627681:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787790933.627684:0:17152:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787790933.627686:0:17152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790933.627687:0:17152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790933.627689:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787790933.627700:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.627728:0:17152:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787790933.627733:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790933.627739:0:17152:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787790933.627742:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.627744:0:17152:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787790933.627747:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790933.627751:0:17152:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000100:00100000:0.0:1787790933.627879:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268114432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790933.627961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.628041:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268114432 00000100:00100000:0.0:1787790933.628048:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268114432 00000100:00100000:0.0:1787790933.628077:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790933.628084:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268114432:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787790933.628100:0:17139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:3.0:1787790933.629834:0:17152:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787790933.629844:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790933.629859:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff916fc34ab370) 00000020:00000080:3.0:1787790933.629880:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787790933.629886:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790933.629980:0:17152:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787790933.629987:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787790933.629994:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eb7d 00010000:00080000:3.0:1787790933.630034:0:17152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170d6142800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790933.630260:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787790933.633461:0:17152:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787790933.634448:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787790933.642132:0:17152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790933.643401:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787790933.652018:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787790933.658980:0:17158:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787790933.658990:0:17158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1787790933.661606:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268114432:12345-0@lo:38:llog_process_th.0 Request processed in 33511us (33635us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787790933.661624:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787790933.661937:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790933.661944:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787790933.661948:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268114432:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1787790933.664119:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787790933.664134:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787790933.664175:0:17152:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787790933.664194:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1eb84 00000100:00080000:3.0:1787790933.664203:0:17152:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790933.664219:0:17152:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170d6142800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790933.664255:0:17152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ad680 x1874634268114560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790933.664396:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268114560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787790933.664449:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268114560 offset 0 length 520: 4 00000100:00080000:3.0:1787790933.664702:0:17152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787790933.664840:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790933.664845:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.664847:0:17152:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787790933.664850:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787790933.664853:0:17152:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787790933.664855:0:17152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790933.664856:0:17152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790933.664858:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787790933.664860:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.664861:0:17152:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787790933.664863:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790933.664867:0:17152:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787790933.664871:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.664872:0:17152:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787790933.664876:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790933.664880:0:17152:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787790933.665047:0:17152:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787790933.665050:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790933.665064:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff916fc34a8000) 00000020:00000080:3.0:1787790933.665078:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787790933.665083:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790933.665141:0:17152:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787790933.665147:0:17152:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787790933.665152:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1eb92 00010000:00080000:3.0:1787790933.665178:0:17152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170d6145800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790933.665596:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787790933.665831:0:17152:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787790933.665856:0:17152:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787790933.668172:0:17152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790933.668428:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787790933.668918:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787790933.669336:0:17160:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787790933.669341:0:17160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787790933.670343:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787790933.670356:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787790933.670403:0:17152:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787790933.670423:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1eb99 00000100:00080000:3.0:1787790933.670433:0:17152:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790933.670439:0:17152:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170d6145800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790933.670486:0:17152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5afc00 x1874634268114688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790933.670522:0:17152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787790933.670626:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268114688:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787790933.670694:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268114688 offset 0 length 520: 4 00000020:01000000:3.0:1787790933.671015:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790933.671019:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.671021:0:17152:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787790933.671024:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790933.671028:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.671030:0:17152:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787790933.671033:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787790933.671034:0:17152:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787790933.671037:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790933.671039:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.671041:0:17152:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787790933.671043:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790933.671045:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.671047:0:17152:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787790933.671050:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787790933.671082:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17152:1874634268114816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790933.671137:0:17152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.671159:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf6e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.671419:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268114816 00000100:00100000:1.0:1787790933.671427:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268114816 00000100:00100000:1.0:1787790933.671485:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790933.671494:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17152:x1874634268114816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790933.671796:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17152:x1874634268114816:12345-0@lo:502:llog_process_th.0 Request processed in 302us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.671810:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790933.671981:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17152:1874634268114816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787790933.672009:0:17152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790933.672014:0:17152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790933.672016:0:17152:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790933.672020:0:17152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787790933.672228:0:17113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787790933.672255:0:17113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787790933.672346:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.672358:0:17113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790933.672377:0:17113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff916fc46e5000 from 1 10000000:01000000:1.0:1787790933.672380:0:17113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790933.672412:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.672421:0:17113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.672430:0:17113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790933.672446:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268114944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790933.672492:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790933.672902:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.673003:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268114944 00000100:00100000:0.0:1787790933.673010:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268114944 00000100:00100000:0.0:1787790933.673089:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787790933.673098:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+9:17113:x1874634268114944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790933.673110:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790933.673126:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1eba0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.673148:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 10 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.673159:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 10 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.673184:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5e00, rc 0) 00000100:00100000:0.0:1787790933.673281:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+10:17113:x1874634268114944:12345-0@lo:101:mount.lustre.0 Request processed in 183us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.673289:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790933.673427:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268114944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790933.673443:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.673453:0:17113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790933.674908:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115072:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787790933.674972:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.675058:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.675103:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115072 00000100:00100000:0.0:1787790933.675109:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115072 00000100:00100000:0.0:1787790933.675193:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790933.675204:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+10:17113:x1874634268115072:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787790933.675222:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787790933.675228:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787790933.675429:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+10:17113:x1874634268115072:12345-0@lo:256:mount.lustre.0 Request processed in 226us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.675437:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787790933.675620:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115072:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787790933.676236:0:17113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787790933.676250:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.676262:0:17113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790933.676571:0:17113:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff916fc46e5000 from 1 10000000:01000000:3.0:1787790933.676577:0:17113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790933.676618:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.676769:0:17113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.676782:0:17113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790933.676802:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787790933.676868:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.677199:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.677263:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115200 00000100:00100000:0.0:1787790933.677278:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115200 00000100:00100000:0.0:1787790933.677320:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790933.677329:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+10:17113:x1874634268115200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790933.677342:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790933.677356:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ebae expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.677391:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 11 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.677402:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 11 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.677424:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5200, rc 0) 00000100:00100000:0.0:1787790933.677475:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17113:x1874634268115200:12345-0@lo:101:mount.lustre.0 Request processed in 146us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.677482:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790933.677929:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790933.677946:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.677955:0:17113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790933.678023:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790933.678052:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.678071:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.678123:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115328 00000100:00100000:0.0:1787790933.678128:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115328 00000100:00100000:0.0:1787790933.678148:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787790933.678155:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17113:x1874634268115328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790933.678410:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17113:x1874634268115328:12345-0@lo:501:mount.lustre.0 Request processed in 255us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.678419:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790933.678834:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790933.678870:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790933.678917:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.678938:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.678992:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115456 00000100:00100000:0.0:1787790933.678997:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115456 00000100:00100000:0.0:1787790933.679034:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790933.679042:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17113:x1874634268115456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790933.679130:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17113:x1874634268115456:12345-0@lo:503:mount.lustre.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.679137:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787790933.679252:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790933.680184:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17162:1874634268115584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790933.680237:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.680376:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787790933.680420:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115584 00000100:00100000:3.0:1787790933.680425:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115584 00000100:00100000:3.0:1787790933.680567:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790933.680577:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17162:x1874634268115584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790933.681393:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17162:x1874634268115584:12345-0@lo:502:llog_process_th.0 Request processed in 815us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790933.681402:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790933.681502:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17162:1874634268115584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790933.681545:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790933.681556:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681565:0:17162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787790933.681573:0:17162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff916fc46e5000 00000020:00000080:0.0:1787790933.681575:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787790933.681593:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790933.681596:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681597:0:17162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787790933.681599:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790933.681602:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681603:0:17162:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787790933.681606:0:17162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff916fc46e5000 00000020:00000080:0.0:1787790933.681607:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787790933.681943:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790933.681948:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681950:0:17162:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787790933.681953:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790933.681955:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681956:0:17162:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787790933.681960:0:17162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff916fc46e5000 00000020:00000080:0.0:1787790933.681963:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787790933.681982:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790933.681985:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681986:0:17162:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787790933.681989:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790933.681991:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.681992:0:17162:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787790933.681996:0:17162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff916fc46e5000 00000020:00000080:0.0:1787790933.681998:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787790933.682040:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17162:1874634268115712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790933.682084:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.686985:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.687072:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115712 00000100:00100000:1.0:1787790933.687081:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115712 00000100:00100000:1.0:1787790933.687130:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787790933.687140:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17162:x1874634268115712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790933.687313:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17162:x1874634268115712:12345-0@lo:502:llog_process_th.0 Request processed in 174us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.687327:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790933.687787:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17162:1874634268115712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787790933.687821:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790933.687834:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790933.687837:0:17162:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787790933.687841:0:17162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787790933.692476:0:17113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787790933.695691:0:17113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790933.695747:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.695761:0:17113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790933.695820:0:17113:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787790933.695824:0:17113:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff916fc46e5000 10000000:01000000:3.0:1787790933.695827:0:17113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff916fc46e5000 10000000:01000000:3.0:1787790933.695832:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787790933.695839:0:17113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff916fc46e5000 from 1 10000000:01000000:3.0:1787790933.695842:0:17113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790933.695881:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.695890:0:17113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.695901:0:17113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790933.695929:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787790933.696004:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.696053:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.696386:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115840 00000100:00100000:1.0:1787790933.696394:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115840 00000100:00100000:1.0:1787790933.696445:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787790933.696463:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17113:x1874634268115840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790933.696476:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790933.696493:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fba00/0xcf9477fddcf1ebc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ebbc expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.696748:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fba00/0xcf9477fddcf1ebc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebbc expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.696760:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fba00/0xcf9477fddcf1ebc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebbc expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.696770:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fba00, rc 0) 00000100:00100000:1.0:1787790933.696822:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268115840:12345-0@lo:101:mount.lustre.0 Request processed in 369us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.696831:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790933.697416:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790933.697436:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.697447:0:17113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790933.697800:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790933.697843:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.697868:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.697938:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268115968 00000100:00100000:1.0:1787790933.697944:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268115968 00000100:00100000:1.0:1787790933.697971:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787790933.697978:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268115968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790933.698729:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268115968:12345-0@lo:501:mount.lustre.0 Request processed in 747us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.698738:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790933.706837:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268115968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790933.706939:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268116096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790933.707014:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.709476:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790933.710862:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116096 00000100:00100000:2.0:1787790933.710879:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116096 00000100:00100000:0.0:1787790933.711027:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790933.711038:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268116096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790933.711204:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268116096:12345-0@lo:503:mount.lustre.0 Request processed in 167us (4190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.711213:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790933.711787:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268116096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790933.713033:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17167:1874634268116224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790933.713149:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790933.713187:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116224 00000100:00100000:2.0:1787790933.713193:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116224 00000100:00100000:2.0:1787790933.713238:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790933.713247:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17167:x1874634268116224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787790933.715379:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17167:x1874634268116224:12345-0@lo:502:llog_process_th.0 Request processed in 1258us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790933.715394:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790933.715479:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790933.715780:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17167:1874634268116224:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787790933.715855:0:17167:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787790933.715874:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9170facf3370) 00000020:00000080:2.0:1787790933.715894:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787790933.715998:0:17167:0:(tgt_mount.c:153:server_get_mount()) get mount ffff916fc46e5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787790933.716002:0:17167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff916fc46e5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787790933.716005:0:17167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff916fc46e5000 4 00010000:00080000:2.0:1787790933.716033:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170ce83e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787790933.723170:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787790933.724000:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787790933.724049:0:17167:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787790933.724064:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf9477fddcf1ebd1 00000100:00080000:3.0:1787790933.724075:0:17167:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790933.724081:0:17167:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9170ce83e800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790933.724130:0:17167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5af480 x1874634268116352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790933.724160:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787790933.724424:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268116352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787790933.724900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790933.735562:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116352 00000100:00100000:0.0:1787790933.735575:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116352 00000100:00100000:0.0:1787790933.735627:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790933.735842:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268116352:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790933.735947:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268116352:12345-0@lo:38:llog_process_th.0 Request processed in 106us (11048us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787790933.735954:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790933.737379:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790933.737393:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170ce83e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790933.737399:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787790933.737403:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268116352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787790933.737622:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17167:1874634268116480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790933.737883:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.737925:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790933.738191:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116480 00000100:00100000:0.0:1787790933.738199:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116480 00000100:00100000:0.0:1787790933.738252:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790933.738261:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17167:x1874634268116480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787790933.738402:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17167:x1874634268116480:12345-0@lo:502:llog_process_th.0 Request processed in 141us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.738411:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787790933.739694:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17167:1874634268116480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790933.739790:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17167:1874634268116608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787790933.739847:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790933.739891:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c4f59480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790933.740022:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116608 00000100:00100000:1.0:1787790933.740029:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116608 00000100:00100000:1.0:1787790933.740071:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790933.740080:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17167:x1874634268116608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787790933.740187:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17167:x1874634268116608:12345-0@lo:502:llog_process_th.0 Request processed in 108us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790933.740195:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790933.740273:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17167:1874634268116608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787790933.740292:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787790933.743879:0:17113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787790933.743922:0:17113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787790933.743988:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790933.744001:0:17113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787790933.744056:0:17113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787790933.744058:0:17113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790933.744059:0:17113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790933.744060:0:17113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790933.744061:0:17113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790933.744062:0:17113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790933.744064:0:17113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790933.744065:0:17113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790933.744067:0:17113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790933.744068:0:17113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790933.744077:0:17113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787790933.744079:0:17113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790933.744080:0:17113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790933.744082:0:17113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790933.744083:0:17113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790933.744084:0:17113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790933.744085:0:17113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790933.744086:0:17113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790933.744087:0:17113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790933.744088:0:17113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790933.744089:0:17113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787790933.744117:0:17113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787790933.744135:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268116736:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787790933.744201:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790933.744243:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c7d0ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790933.744311:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116736 00000100:00100000:3.0:1787790933.744319:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116736 00000100:00100000:3.0:1787790933.744380:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790933.744390:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268116736:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787790933.744416:0:17129:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787790933.744429:0:17129:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787790933.757080:0:17129:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787790933.757097:0:17129:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787790933.759486:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17113:x1874634268116736:12345-0@lo:253:mount.lustre.0 Request processed in 15091us (15278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790933.759500:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1787790933.761762:0:17150:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790933.761772:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790933.761802:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.761818:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 11 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.761825:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.761864:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 11 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790933.761878:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 11 pid: 17128 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790933.761891:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268116864:0@lo:104: 00000100:00100000:2.0:1787790933.761950:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790933.761995:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790933.763834:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116864 00000100:00100000:3.0:1787790933.763846:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116864 00000100:00100000:3.0:1787790933.763899:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790933.763909:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268116864:12345-0@lo:104: 00010000:00010000:3.0:1787790933.763924:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.764018:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790933.764024:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268116864:12345-0@lo:104: Request processed in 118us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790933.764032:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787790933.764057:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790933.764063:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.764070:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787790933.764073:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.764082:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787790933.764088:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790933.764093:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790933.764127:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.764132:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787790933.764148:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.764155:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1eba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1eba7 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.764181:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790933.764184:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790933.764185:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790933.764215:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268116992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790933.764250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790933.765112:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17113:1874634268116736:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787790933.765127:0:17113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787790933.765130:0:17113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790933.765132:0:17113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787790933.765134:0:17113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790933.765135:0:17113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790933.765136:0:17113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790933.765138:0:17113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790933.765139:0:17113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790933.765140:0:17113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787790933.765142:0:17113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790933.765144:0:17113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787790933.765158:0:17113:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787790933.765859:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268116864:0@lo:104: 00010000:00010000:2.0:1787790933.765879:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790933.766936:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268116992 00000100:00100000:0.0:1787790933.766946:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268116992 00010000:00010000:0.0:1787790933.766975:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 12 pid: 17128 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790933.767004:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790933.767012:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:3639:x1874634268116992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790933.767027:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790933.767033:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 12 pid: 17128 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767045:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 12 pid: 17128 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767064:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad5e00/0xcf9477fddcf1eba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1eba0 expref: 12 pid: 17128 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767082:0:17119:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767102:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790933.767119:0:17119:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005348064s 00010000:00010000:0.0:1787790933.767124:0:17119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767132:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767139:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767147:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767153:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790933.767158:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767167:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767190:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790933.767200:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790933.767261:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:3639:x1874634268116992:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790933.767279:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790933.767418:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268116992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790933.767443:0:17150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.767452:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790933.767470:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1ebd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787790933.788913:0:17113:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787790933.789307:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787790933.791041:0:17175:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787790933.791464:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1787790933.792125:0:17176:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9170ff5ada40 x1874634268117120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790933.792137:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000040:00080000:1.0:1787790933.792225:0:17175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787790933.795078:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787790933.795124:0:17113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787790933.795653:0:17113:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787790933.795662:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787790933.795747:0:17113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790933.796804:0:17113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787790933.797345:0:17113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787790933.797389:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787790933.799405:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787790933.799491:0:17175:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:2.0:1787790933.799769:0:17174:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787790933.799774:0:17174:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00080000:10000000:0.0:1787790933.801114:0:17113:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1787790933.803138:0:17113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787790933.804845:0:17113:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787790933.804878:0:17113:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8b301c67988 00100000:10000000:0.0:1787790933.804886:0:17113:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787790933.806015:0:17113:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787790933.806033:0:17113:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787790933.806052:0:17113:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787790933.806073:0:17113:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787790933.807144:0:17113:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790933.807370:0:17113:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787790934.283893:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790934.738366:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787790934.799242:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 10000000:01000000:3.0:1787790934.986864:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787790934.986873:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff916fc46e5000 from 7 10000000:01000000:3.0:1787790934.986878:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787790934.986934:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790934.986947:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790934.986983:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790934.987023:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268117248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790934.987100:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790934.987151:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790934.987314:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117248 00000100:00100000:1.0:1787790934.987327:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117248 00000100:00100000:1.0:1787790934.987401:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790934.987412:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+11:17131:x1874634268117248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790934.987426:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790934.987439:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ebdf expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790934.987464:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790934.987474:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790934.987483:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb400, rc 0) 00000100:00100000:1.0:1787790934.987535:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17131:x1874634268117248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790934.987542:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787790934.987749:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268117248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790934.987763:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790934.987772:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790934.987823:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268117376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787790934.987854:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790934.987884:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790934.987942:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117376 00000100:00100000:2.0:1787790934.987948:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117376 00000100:00100000:2.0:1787790934.987982:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790934.987990:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17131:x1874634268117376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787790934.988003:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787790934.988021:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787790934.988028:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787790934.988114:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17131:x1874634268117376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790934.988122:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787790934.988229:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268117376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787790934.988279:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787790934.988287:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790934.988304:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790935.306997:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790935.755400:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787790935.820657:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790936.331792:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790936.846168:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:3.0:1787790937.357260:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790937.873851:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790938.380932:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790938.643961:0:17419:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787790938.891140:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000100:00080000:0.0:1787790938.956279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787790938.956286:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787790938.956290:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790938.956299:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1787790938.956305:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787790938.956323:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9170eef42800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790938.956367:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4595680 x1874634268117632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790938.956393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790938.956397:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790938.956399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790938.956402:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787790938.956405:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1787790938.956405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787790938.956407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787790938.956410:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170ce83e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790938.956415:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9170ce83e800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790938.956418:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268117504:0@lo:400:kworker.0 00000100:00100000:0.0:1787790938.956425:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc45943c0 x1874634268117760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787790938.956567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790938.956731:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117504 00000100:00100000:0.0:1787790938.956739:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117504 00000100:00100000:0.0:1787790938.956791:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787790938.956800:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:3641:x1874634268117504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790938.956865:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:3641:x1874634268117504:12345-0@lo:400:kworker.0 Request processed in 65us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790938.956872:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790938.956917:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268117504:0@lo:400:kworker.0 00000100:00100000:1.0:1787790938.957161:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268117632:0@lo:38:kworker.0 00000100:00100000:1.0:1787790938.957246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790938.957276:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268117760:0@lo:38:kworker.0 00000100:00100000:1.0:1787790938.957299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790938.957366:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117760 00000100:00100000:3.0:1787790938.957371:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117760 00000100:00100000:2.0:1787790938.957396:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117632 00000100:00100000:3.0:1787790938.957400:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790938.957400:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117632 00000100:00100000:3.0:1787790938.957405:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634268117760:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787790938.957425:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790938.957426:0:17136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000100:00100000:2.0:1787790938.957430:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268117632:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787790938.957440:0:17140:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1787790938.957458:0:17136:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf9477fddcf1ebed 00000004:00100000:3.0:1787790938.957472:0:17136:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787790938.957600:0:17136:0:(import.c:65:import_set_state_nolock()) ffff9170d6148800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790938.957642:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874634268117760:12345-0@lo:38:kworker.0 Request processed in 235us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790938.957650:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790938.957683:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff916fc45943c0 x1874634268117760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787790938.957696:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787790938.957725:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787790938.957730:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787790938.957732:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170ce83e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787790938.957738:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268117760:0@lo:38:kworker.0 00000100:00100000:2.0:1787790938.976233:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268117632:12345-0@lo:38:kworker.0 Request processed in 18793us (18979us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787790938.976247:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787790938.983256:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790938.983269:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787790938.983274:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268117632:0@lo:38:kworker.0 00010000:00010000:3.0:1787790939.413384:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787790939.505616:0:17471:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790939.506015:0:17471:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787790939.919728:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:1.0:1787790940.427134:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787790940.462456:0:17521:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790940.463113:0:17521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787790940.939021:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790941.451913:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790941.965982:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:1.0:1787790942.474908:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790942.987817:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000100:00100000:2.0:1787790943.052789:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790933/real 1787790933] req@ffff9170ff5afc00 x1874634268114688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790943.052823:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170ff5afc00 x1874634268114688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790943.052833:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790933/real 1787790933] req@ffff9170ff5ad680 x1874634268114560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790943.052845:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170ff5ad680 x1874634268114560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787790943.052877:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787790943.052902:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787790943.052906:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268114688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787790943.052912:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787790943.052918:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787790943.052921:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268114560:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787790943.053095:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787790943.053100:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787790943.053102:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790943.053108:0:15159:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1787790943.053114:0:15159:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787790943.053126:0:15159:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9170eef42800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790943.053147:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ae580 x1874634268118016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790943.053160:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790943.053163:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787790943.053165:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790943.053167:0:15159:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1787790943.053170:0:15159:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787790943.053173:0:15159:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170d6142800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790943.053183:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5af0c0 x1874634268118144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790943.053191:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790943.053193:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787790943.053195:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790943.053198:0:15159:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1787790943.053200:0:15159:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787790943.053203:0:15159:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170d6145800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790943.053213:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ad2c0 x1874634268118272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790943.053250:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790943.053263:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268117888:0@lo:400:kworker.0 00000100:00100000:3.0:1787790943.053344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790943.053396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268118400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790943.053536:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268118016:0@lo:38:kworker.0 00000100:00100000:2.0:1787790943.059101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790943.059164:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268118144:0@lo:8:kworker.0 00000400:00000100:2.0:1787790943.059206:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268118144 offset 0 length 520: 4 00000100:00100000:2.0:1787790943.059220:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268118272:0@lo:8:kworker.0 00000400:00000100:2.0:1787790943.059240:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268118272 offset 0 length 520: 4 00000100:00100000:2.0:1787790943.059321:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117888 00000100:00100000:2.0:1787790943.059329:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117888 00000100:00100000:2.0:1787790943.059376:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790943.059386:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:3640:x1874634268117888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790943.059459:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:3640:x1874634268117888:12345-0@lo:400:kworker.0 Request processed in 73us (6114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790943.059466:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790943.059528:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268117888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790943.059664:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268118016 00000100:00100000:0.0:1787790943.059680:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268118016 00000100:00100000:0.0:1787790943.059730:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790943.059736:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268118016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787790943.059753:0:17139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787790943.064890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790943.065325:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268118400 00000100:00100000:2.0:1787790943.065335:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268118400 00000100:00100000:2.0:1787790943.065382:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787790943.065398:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268118400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790943.065484:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268118400:12345-0@lo:400:kworker.0 Request processed in 88us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790943.065492:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787790943.065673:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9170ff5ae1c0 x1874634268118400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790943.065689:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268118400:0@lo:400:kworker.0 00000100:00100000:0.0:1787790943.100809:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268118016:12345-0@lo:38:kworker.0 Request processed in 41064us (41709us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787790943.100824:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787790943.100881:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790943.100888:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787790943.100892:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268118016:0@lo:38:kworker.0 00010000:00010000:0.0:1787790943.498940:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790944.014564:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:1.0:1787790944.526183:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790945.034830:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790945.547368:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787790945.997064:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787790946.069209:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790946.573761:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790947.083896:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000020:01000004:2.0:1787790947.226935:0:17866:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790947.226939:0:17866:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787790947.226941:0:17866:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787790947.227059:0:17866:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170ce839000 00000020:01000004:2.0:1787790947.227086:0:17866:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787790947.227163:0:17866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787790947.227180:0:17866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9170facf4d28) 00000020:00000080:2.0:1787790947.227200:0:17866:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787790947.279133:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787790947.280459:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787790947.282645:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.283094:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.283429:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.286124:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.286654:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.287092:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.287404:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.287668:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.288058:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.288364:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.289301:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.289540:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.289854:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.290126:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.290470:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.290678:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.291144:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.291423:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.291685:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.292080:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.292302:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.292523:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.293104:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.293430:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.293626:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.293894:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.294358:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.294648:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.295085:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.295366:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.295655:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787790947.296042:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787790947.297979:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787790947.298612:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787790947.299029:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787790947.299279:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787790947.299517:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787790947.299816:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787790947.300118:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787790947.300379:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787790947.300634:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787790947.300973:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787790947.301281:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787790947.301517:0:17866:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:2.0:1787790947.302275:0:17866:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787790947.302630:0:17866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787790947.302642:0:17866:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790947.302654:0:17866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1ebfb 00000020:01000004:2.0:1787790947.302661:0:17866:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787790947.302683:0:17866:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787790947.302687:0:17866:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787790947.302693:0:17866:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787790947.302795:0:17866:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787790947.302800:0:17866:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787790947.307396:0:17866:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787790947.307433:0:17866:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787790947.307438:0:17866:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787790947.307440:0:17866:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787790947.307441:0:17866:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790947.307442:0:17866:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790947.307444:0:17866:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790947.307445:0:17866:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790947.307446:0:17866:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790947.307448:0:17866:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790947.307449:0:17866:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790947.307453:0:17866:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787790947.307455:0:17866:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787790947.307457:0:17866:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787790947.307458:0:17866:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790947.307459:0:17866:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790947.307460:0:17866:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790947.307461:0:17866:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790947.307462:0:17866:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790947.307463:0:17866:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790947.307463:0:17866:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787790947.307494:0:17866:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787790947.307580:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787790947.308291:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.308340:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268118528 00000100:00100000:2.0:1787790947.308348:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268118528 00000100:00100000:2.0:1787790947.308525:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790947.308536:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17866:x1874634268118528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787790947.308581:0:17129:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787790947.308585:0:17129:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787790947.308592:0:17129:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787790947.308653:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c7d0c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.308914:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17866:x1874634268118528:12345-0@lo:253:mount.lustre.0 Request processed in 379us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.308923:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790947.308977:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787790947.308991:0:17866:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787790947.308994:0:17866:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787790947.308995:0:17866:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787790947.308996:0:17866:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787790947.308997:0:17866:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787790947.308998:0:17866:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787790947.309006:0:17866:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787790947.309008:0:17866:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787790947.309009:0:17866:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787790947.309010:0:17866:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787790947.309030:0:17866:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170ce839000 from lustre-MDT0001 10000000:01000000:1.0:1787790947.309053:0:17866:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787790947.309056:0:17866:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787790947.309062:0:17866:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9170fc134d28 local copy 00010000:00010000:1.0:1787790947.309072:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790947.309444:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790947.309474:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.309499:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.309521:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268118656 00000100:00100000:0.0:1787790947.309527:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268118656 00000100:00100000:0.0:1787790947.309595:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787790947.309604:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17866:x1874634268118656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790947.309661:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17866:x1874634268118656:12345-0@lo:501:mount.lustre.0 Request processed in 59us (186us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787790947.309668:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790947.309870:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118656:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787790947.310139:0:17866:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787790947.310153:0:17866:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787790947.310158:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310165:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790947.310182:0:17866:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170ce839000 10000000:01000000:1.0:1787790947.310186:0:17866:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787790947.310189:0:17866:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9170fc134d28 10000000:01000000:1.0:1787790947.310190:0:17866:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787790947.310192:0:17866:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9170fc134d28 from 1 10000000:01000000:1.0:1787790947.310195:0:17866:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787790947.310211:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310222:0:17866:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310229:0:17866:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790947.310237:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790947.310279:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.310304:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.310315:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268118784 00000100:00100000:2.0:1787790947.310320:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268118784 00000100:00100000:2.0:1787790947.310353:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787790947.310361:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+12:17866:x1874634268118784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790947.310375:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790947.310398:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994a00/0xcf9477fddcf1ec09 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ec02 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.310419:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994a00/0xcf9477fddcf1ec09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ec02 expref: 13 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.310431:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994a00/0xcf9477fddcf1ec09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ec02 expref: 13 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.310439:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994a00, rc 0) 00000100:00100000:2.0:1787790947.310476:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+13:17866:x1874634268118784:12345-0@lo:101:mount.lustre.0 Request processed in 115us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.310482:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790947.310500:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790947.310570:0:17866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310580:0:17866:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790947.310654:0:17866:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787790947.310666:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310673:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790947.310678:0:17866:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9170ce839000 10000000:01000000:1.0:1787790947.310682:0:17866:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787790947.310756:0:17866:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9170ce839000 from 1 10000000:01000000:1.0:1787790947.310760:0:17866:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787790947.310779:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310787:0:17866:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.310795:0:17866:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790947.310864:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790947.310943:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.310969:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.311024:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268118912 00000100:00100000:0.0:1787790947.311028:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268118912 00000100:00100000:0.0:1787790947.311053:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790947.311060:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+13:17866:x1874634268118912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790947.311068:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790947.311082:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad5400/0xcf9477fddcf1ec17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ec10 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.311155:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad5400/0xcf9477fddcf1ec17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ec10 expref: 14 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.311165:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad5400/0xcf9477fddcf1ec17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ec10 expref: 14 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.311171:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5400, rc 0) 00000100:00100000:0.0:1787790947.311205:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+14:17866:x1874634268118912:12345-0@lo:101:mount.lustre.0 Request processed in 145us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.311211:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790947.311288:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268118912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790947.311298:0:17866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.311305:0:17866:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790947.311372:0:17866:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787790947.311387:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.311395:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790947.311400:0:17866:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787790947.311404:0:17866:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790947.311407:0:17866:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9170ce839000 10000000:01000000:1.0:1787790947.311414:0:17866:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787790947.311417:0:17866:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787790947.311419:0:17866:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787790947.311432:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.311439:0:17866:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.311446:0:17866:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790947.311456:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790947.311478:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.311499:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.311685:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119040 00000100:00100000:2.0:1787790947.311769:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119040 00000100:00100000:2.0:1787790947.311891:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787790947.311899:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+14:17866:x1874634268119040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790947.311906:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790947.311916:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1ec25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ec1e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.311929:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1ec25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ec1e expref: 15 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.311937:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1ec25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ec1e expref: 15 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.311943:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994000, rc 0) 00000100:00100000:2.0:1787790947.311977:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119040:12345-0@lo:101:mount.lustre.0 Request processed in 79us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.311983:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790947.312139:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790947.312150:0:17866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.312157:0:17866:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790947.314015:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787790947.315393:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790947.322982:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787790947.323042:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787790947.323058:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787790947.323074:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787790947.323086:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787790947.323169:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787790947.323194:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787790947.323207:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787790947.323220:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787790947.323234:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787790947.323261:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787790947.323273:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787790947.323283:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787790947.323296:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787790947.323308:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787790947.323446:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787790947.323464:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787790947.323477:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787790947.323490:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787790947.323503:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787790947.323638:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787790947.323661:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787790947.323676:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787790947.324061:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787790947.324070:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787790947.324235:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790947.324381:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.324466:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.324649:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119168 00000100:00100000:0.0:1787790947.324657:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119168 00000100:00100000:0.0:1787790947.324777:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787790947.324788:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790947.325249:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119168:12345-0@lo:501:mount.lustre.0 Request processed in 453us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.325257:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787790947.325333:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790947.325370:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790947.325424:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.325995:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787790947.326052:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119296 00000100:00100000:3.0:1787790947.326056:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119296 00000100:00100000:3.0:1787790947.326083:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787790947.326091:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790947.327117:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119296:12345-0@lo:503:mount.lustre.0 Request processed in 1023us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790947.327128:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790947.327382:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787790947.328455:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790947.328869:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790947.329009:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.329102:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.329160:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119424 00000100:00100000:2.0:1787790947.329167:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119424 00000100:00100000:3.0:1787790947.329461:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787790947.329473:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.330749:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119424:12345-0@lo:502:mount.lustre.0 Request processed in 1273us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790947.330761:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790947.330989:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790947.331282:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787790947.331472:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787790947.331496:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787790947.331650:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787790947.331673:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787790947.331687:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787790947.331700:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787790947.331749:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787790947.331764:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787790947.331776:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787790947.331797:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787790947.332079:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787790947.332158:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787790947.332179:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787790947.332192:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787790947.332205:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787790947.332219:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787790947.332233:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787790947.332275:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787790947.332290:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787790947.332303:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787790947.332498:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787790947.332528:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787790947.332545:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787790947.332557:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787790947.332570:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787790947.332582:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787790947.332607:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787790947.332630:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787790947.332644:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787790947.332657:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787790947.332670:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787790947.332683:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787790947.332735:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787790947.332763:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787790947.332777:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787790947.332790:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787790947.332977:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787790947.332998:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787790947.333012:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787790947.333026:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787790947.333040:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787790947.333052:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787790947.333064:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787790947.333173:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790947.333258:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.334066:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.334165:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119552 00000100:00100000:0.0:1787790947.334172:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119552 00000100:00100000:3.0:1787790947.334226:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790947.334248:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.334391:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268119552:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790947.334400:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787790947.334702:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268119552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790947.334789:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1787790947.334813:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787790947.336164:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790947.336177:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790947.336180:0:17870:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787790947.336185:0:17870:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787790947.336188:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790947.336204:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff916fc3208000) 00000020:00000080:1.0:1787790947.336225:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787790947.336230:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787790947.336333:0:17870:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787790947.336345:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1ec33 00000020:00000080:1.0:1787790947.336835:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787790947.336840:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790947.336844:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790947.336846:0:17870:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787790947.336849:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790947.336853:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790947.336854:0:17870:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787790947.336858:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790947.336865:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff916fc320cd28) 00000020:00000080:1.0:1787790947.337036:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787790947.337044:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787790947.337046:0:17870:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787790947.337049:0:17870:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787790947.337056:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787790947.337115:0:17870:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170ce839000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787790947.337128:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9170d6383370) 00000020:00000080:1.0:1787790947.337138:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787790947.337203:0:17870:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787790947.337209:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1ec48 00000020:00000080:1.0:1787790947.337448:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787790947.337456:0:17870:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787790947.337460:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf9477fddcf1ec4f 00080000:01000000:1.0:1787790947.337467:0:17870:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787790947.337471:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1ec56 00010000:00010000:1.0:1787790947.423182:0:17870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1787790947.424058:0:17870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1787790947.424461:0:17870:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787790947.426962:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787790947.426977:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.426984:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.426992:0:17870:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787790947.426996:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.427002:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.427003:0:17870:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787790947.427006:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790947.427011:0:17870:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:3.0:1787790947.427038:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790947.427052:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff916fc34acd28) 00000020:00000080:3.0:1787790947.427073:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787790947.427078:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790947.427223:0:17870:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787790947.427230:0:17870:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787790947.427248:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1ec64 00010000:00080000:3.0:1787790947.427281:0:17870:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170d614f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790947.432293:0:17870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787790947.440282:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787790947.440299:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787790947.440340:0:17870:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787790947.440363:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1ec6b 00000100:00080000:0.0:1787790947.440377:0:17870:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787790947.440394:0:17870:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170d614f800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790947.440435:0:17870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc45970c0 x1874634268119680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790947.440479:0:17870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787790947.440529:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790947.440533:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790947.440535:0:17870:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787790947.440538:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787790947.440540:0:17870:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787790947.440542:0:17870:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790947.440544:0:17870:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790947.440545:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787790947.440548:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790947.440549:0:17870:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787790947.440551:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790947.440556:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790947.440557:0:17870:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787790947.440560:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787790947.440923:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268119680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787790947.441005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:0.0:1787790947.441188:0:17870:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787790947.441208:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790947.441212:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790947.441214:0:17870:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787790947.441216:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787790947.441218:0:17870:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787790947.441219:0:17870:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790947.441221:0:17870:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790947.441222:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787790947.441224:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790947.441226:0:17870:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787790947.441228:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787790947.441231:0:17870:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787790947.441235:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790947.441248:0:17870:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787790947.441252:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787790947.441257:0:17870:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:0.0:1787790947.441283:0:17870:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787790947.441286:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787790947.441298:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9170fc130000) 00000020:00000080:0.0:1787790947.441311:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787790947.441316:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1787790947.441475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787790947.441479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787790947.441482:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790947.441487:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1787790947.441492:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787790947.441495:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9170eef42800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790947.441524:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe89680 x1874634268119808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790947.441544:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.441548:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790947.441550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.441553:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787790947.441727:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268119808:0@lo:38:kworker.0 00000100:00100000:3.0:1787790947.441757:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.441794:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119680 00000100:00100000:3.0:1787790947.441801:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119680 00000100:00100000:3.0:1787790947.441820:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119808 00000100:00100000:3.0:1787790947.441823:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119808 00000100:00100000:3.0:1787790947.441834:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790947.441840:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268119680:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787790947.441970:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268119936:0@lo:400:kworker.0 00000100:00100000:2.0:1787790947.442008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.442040:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268119936 00000100:00100000:2.0:1787790947.442043:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268119936 00000100:00100000:2.0:1787790947.442070:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790947.442074:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268119936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790947.442193:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268119936:12345-0@lo:400:kworker.0 Request processed in 117us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.442208:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787790947.442257:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9170fbe8b0c0 x1874634268119936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790947.442269:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268119936:0@lo:400:kworker.0 00000004:00080000:0.0:1787790947.442350:0:17870:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00010000:00080000:3.0:1787790947.442601:0:17139:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1787790947.442633:0:17139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1ec79 00000004:00100000:3.0:1787790947.442647:0:17139:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787790947.442652:0:17139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00080000:01000000:0.0:1787790947.443182:0:17870:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787790947.443191:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1ec80 00010000:00080000:0.0:1787790947.443235:0:17870:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170d614d000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787790947.443654:0:17870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1787790947.445009:0:17870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787790947.445342:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787790947.448016:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790947.448301:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787790947.448590:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1787790947.449530:0:17875:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787790947.449537:0:17875:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787790947.450968:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787790947.450982:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787790947.451026:0:17870:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787790947.451047:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1ec87 00000100:00080000:3.0:1787790947.451058:0:17870:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790947.451064:0:17870:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170d614d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790947.451195:0:17870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5aed00 x1874634268120064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790947.451261:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268120064:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787790947.451315:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268120064 offset 0 length 520: 4 00000100:00080000:3.0:1787790947.451475:0:17870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787790947.451542:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.451546:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.451548:0:17870:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787790947.451551:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787790947.451553:0:17870:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787790947.451554:0:17870:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790947.451556:0:17870:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787790947.451558:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787790947.451560:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.451562:0:17870:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787790947.451565:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787790947.451569:0:17870:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787790947.451571:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.451572:0:17870:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787790947.451575:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787790947.451578:0:17870:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787790947.451607:0:17870:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787790947.451609:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787790947.451620:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff916fc34a99b8) 00000020:00000080:3.0:1787790947.451632:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787790947.451637:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787790947.451719:0:17870:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787790947.451734:0:17870:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787790947.451740:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1ec95 00010000:00080000:3.0:1787790947.451776:0:17870:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170d6153000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787790947.452260:0:17870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787790947.452328:0:17870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787790947.452343:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1787790947.453132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.453138:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790947.453141:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.453143:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790947.454199:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9171011a9000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787790947.456146:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787790947.456317:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634268119680:12345-0@lo:38:llog_process_th.0 Request processed in 14470us (15306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.456330:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790947.456365:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790947.456372:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268119808:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787790947.456441:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268119808:12345-0@lo:38:kworker.0 Request processed in 68us (14683us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787790947.456447:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1787790947.456647:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787790947.456787:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787790947.457215:0:17877:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787790947.457221:0:17877:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1787790947.458432:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790947.458447:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787790947.458455:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787790947.458462:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787790947.458466:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787790947.458492:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268119680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790947.458602:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790947.458833:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790947.458839:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790947.458843:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787790947.458846:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268119808:0@lo:38:kworker.0 00000020:00000080:3.0:1787790947.459003:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787790947.459015:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787790947.459051:0:17870:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787790947.459068:0:17870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1ec9c 00000100:00080000:3.0:1787790947.459073:0:17870:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787790947.459078:0:17870:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170d6153000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790947.459099:0:17870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ad680 x1874634268120320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790947.459122:0:17870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787790947.459159:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268120320:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1787790947.459164:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.459168:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.459170:0:17870:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787790947.459173:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.459177:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.459178:0:17870:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787790947.459181:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787790947.459183:0:17870:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787790947.459185:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.459187:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.459188:0:17870:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787790947.459190:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.459191:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.459192:0:17870:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000400:00000100:1.0:1787790947.459205:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268120320 offset 0 length 520: 4 00000020:00000080:3.0:1787790947.459207:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787790947.459234:0:17870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.459249:0:17870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.459251:0:17870:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787790947.459254:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1787790947.459349:0:17866:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787790947.459376:0:17866:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787790947.459395:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.459406:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790947.459414:0:17866:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce839000 from 1 10000000:01000000:1.0:1787790947.459417:0:17866:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790947.459442:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.459449:0:17866:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.459457:0:17866:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790947.459471:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790947.459518:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.459542:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f480 going to sleep for 11 seconds 00000100:00080000:2.0:1787790947.462629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.462637:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790947.462639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.462642:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787790947.462664:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268120448 00000100:00100000:2.0:1787790947.462687:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268120448 00000100:00100000:2.0:1787790947.462760:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787790947.462769:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+15:17866:x1874634268120448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790947.462784:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790947.462802:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1eca3 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.462829:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 16 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.462839:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 16 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.462847:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995c00, rc 0) 00000100:00100000:2.0:1787790947.462918:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:17866:x1874634268120448:12345-0@lo:101:mount.lustre.0 Request processed in 150us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.462925:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790947.463591:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790947.463610:0:17866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.463620:0:17866:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790947.464197:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120576:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787790947.464262:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.464299:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.464506:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268120576 00000100:00100000:2.0:1787790947.464514:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268120576 00000100:00100000:2.0:1787790947.464553:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787790947.464562:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:17866:x1874634268120576:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787790947.464579:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787790947.464598:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787790947.464602:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787790947.464688:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:17866:x1874634268120576:12345-0@lo:256:mount.lustre.0 Request processed in 126us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.464695:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787790947.464749:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120576:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787790947.465325:0:17866:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787790947.465342:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.465353:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790947.465361:0:17866:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170ce839000 from 1 10000000:01000000:2.0:1787790947.465364:0:17866:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:0.0:1787790947.465997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268120192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790947.466045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.466116:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268120192 00000100:00100000:3.0:1787790947.466121:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268120192 00000100:00100000:3.0:1787790947.466162:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787790947.466170:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874634268120192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790947.466198:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790947.466252:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874634268120192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790947.466259:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790947.466365:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268120192:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787790947.466495:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.466503:0:17866:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.466513:0:17866:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790947.466528:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790947.466557:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.466624:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30300 going to sleep for 11 seconds 00000100:00100000:1.0:1787790947.468848:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268120704 00000100:00100000:1.0:1787790947.468861:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268120704 00000100:00100000:1.0:1787790947.468947:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787790947.468956:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:17866:x1874634268120704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790947.468971:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790947.468986:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ecb1 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.469013:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.469023:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790947.469032:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa200, rc 0) 00000100:00100000:1.0:1787790947.469104:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268120704:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790947.469123:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787790947.469195:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790947.469212:0:17866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790947.469222:0:17866:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790947.469373:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790947.469425:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790947.469457:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.469606:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.469675:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268120832 00000100:00100000:2.0:1787790947.469679:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268120832 00000100:00100000:2.0:1787790947.469729:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787790947.469739:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268120832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790947.469817:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268120832:12345-0@lo:501:mount.lustre.0 Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.469824:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790947.469906:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790947.469932:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790947.469970:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.470000:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.470039:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268120960 00000100:00100000:2.0:1787790947.470043:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268120960 00000100:00100000:2.0:1787790947.470060:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787790947.470066:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268120960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790947.470140:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268120960:12345-0@lo:503:mount.lustre.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.470147:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787790947.470212:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268120960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787790947.470561:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790947.470631:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.470664:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.470687:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.470815:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121088 00000100:00100000:2.0:1787790947.470819:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121088 00000100:00100000:2.0:1787790947.470838:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787790947.470844:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268121088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790947.470918:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268121088:12345-0@lo:502:mount.lustre.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.470925:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790947.470988:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790947.471181:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787790947.471207:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1787790947.471223:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1787790947.471247:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1787790947.471262:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1787790947.471274:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1787790947.471288:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1787790947.471302:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1787790947.471315:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787790947.471330:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1787790947.471357:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1787790947.471379:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.471477:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.471538:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790947.471590:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121216 00000100:00100000:1.0:1787790947.471594:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121216 00000100:00100000:2.0:1787790947.471636:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787790947.471643:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268121216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790947.471732:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268121216:12345-0@lo:502:mount.lustre.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.471739:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790947.471895:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790947.471930:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1787790947.471937:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787790947.472316:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.472325:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472327:0:17879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787790947.472334:0:17879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170ce839000 00000020:00000080:3.0:1787790947.472343:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790947.472350:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.472353:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472355:0:17879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787790947.472357:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.472360:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472361:0:17879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787790947.472364:0:17879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170ce839000 00000020:00000080:3.0:1787790947.472367:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790947.472493:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.472497:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472499:0:17879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787790947.472502:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.472505:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472506:0:17879:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790947.472509:0:17879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170ce839000 00000020:00000080:3.0:1787790947.472512:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790947.472530:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.472533:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472534:0:17879:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790947.472536:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790947.472538:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472539:0:17879:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787790947.472542:0:17879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170ce839000 00000020:00000080:3.0:1787790947.472544:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790947.472564:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790947.472568:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790947.472569:0:17879:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787790947.472571:0:17879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1787790947.475502:0:17866:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787790947.475550:0:17866:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790947.475572:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.475583:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790947.475660:0:17866:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787790947.475663:0:17866:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170ce839000 10000000:01000000:2.0:1787790947.475666:0:17866:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170ce839000 10000000:01000000:2.0:1787790947.475670:0:17866:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787790947.475676:0:17866:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170ce839000 from 1 10000000:01000000:2.0:1787790947.475679:0:17866:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787790947.475728:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.475736:0:17866:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.475748:0:17866:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790947.475771:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787790947.475836:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.475874:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30300 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.475893:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121344 00000100:00100000:2.0:1787790947.475900:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121344 00000100:00100000:2.0:1787790947.475940:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787790947.475949:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17866:x1874634268121344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790947.475961:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790947.475973:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1ecc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ecbf expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.475995:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1ecc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecbf expref: 18 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.476018:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1ecc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecbf expref: 18 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.476025:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995a00, rc 0) 00000100:00100000:2.0:1787790947.476062:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121344:12345-0@lo:101:mount.lustre.0 Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.476069:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787790947.476115:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790947.476129:0:17866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.476138:0:17866:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790947.480993:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787790947.481284:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790947.490518:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787790947.490573:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787790947.490598:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787790947.490612:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787790947.490626:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787790947.490637:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787790947.490648:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787790947.490660:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787790947.490672:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787790947.490700:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787790947.490746:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787790947.490761:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787790947.490773:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787790947.490786:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787790947.490799:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787790947.490811:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787790947.490824:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787790947.490838:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787790947.490852:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787790947.490865:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787790947.490878:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787790947.490890:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787790947.490903:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787790947.490916:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787790947.490927:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787790947.490953:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787790947.490969:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787790947.490985:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787790947.491013:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787790947.491019:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787790947.491124:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790947.491191:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.491233:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.491394:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121472 00000100:00100000:0.0:1787790947.491402:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121472 00000100:00100000:0.0:1787790947.491455:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787790947.491465:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790947.491591:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121472:12345-0@lo:501:mount.lustre.0 Request processed in 128us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.491598:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787790947.491813:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790947.491852:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790947.491887:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.491914:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.492542:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121600 00000100:00100000:2.0:1787790947.492548:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121600 00000100:00100000:0.0:1787790947.492660:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787790947.492669:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790947.492776:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121600:12345-0@lo:503:mount.lustre.0 Request processed in 108us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.492782:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787790947.493999:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787790947.496513:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790947.496603:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.496678:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.496727:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.496887:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121728 00000100:00100000:0.0:1787790947.496894:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121728 00000100:00100000:0.0:1787790947.496934:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787790947.496942:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790947.497051:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121728:12345-0@lo:502:mount.lustre.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.497059:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787790947.497673:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790947.497895:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787790947.497922:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1787790947.501142:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1787790947.501180:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1787790947.501197:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1787790947.501212:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1787790947.501226:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1787790947.501251:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1787790947.501267:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1787790947.501280:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1787790947.501292:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1787790947.501308:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1787790947.501321:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1787790947.501336:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1787790947.501349:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1787790947.501361:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1787790947.501374:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1787790947.501401:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1787790947.501432:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1787790947.501455:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1787790947.501469:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1787790947.501483:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1787790947.501494:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1787790947.501506:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1787790947.501519:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1787790947.501531:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1787790947.501542:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1787790947.501554:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1787790947.501568:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1787790947.501582:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1787790947.501595:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1787790947.501607:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1787790947.501620:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1787790947.501634:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1787790947.501662:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1787790947.501677:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1787790947.501691:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1787790947.501770:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1787790947.501788:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1787790947.501800:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1787790947.501812:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1787790947.501826:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1787790947.501840:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1787790947.501854:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1787790947.501867:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1787790947.501880:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1787790947.501893:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1787790947.501906:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1787790947.501963:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.502040:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.502079:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.502215:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121856 00000100:00100000:2.0:1787790947.502222:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121856 00000100:00100000:2.0:1787790947.502290:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790947.502299:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790947.502467:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121856:12345-0@lo:502:mount.lustre.0 Request processed in 168us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.502475:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790947.502541:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790947.502760:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787790947.502781:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1787790947.502809:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790947.502845:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.502869:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30300 going to sleep for 11 seconds 00000100:00100000:3.0:1787790947.503283:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268121984 00000100:00100000:3.0:1787790947.503288:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268121984 00000100:00100000:3.0:1787790947.503322:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787790947.503330:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790947.503423:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268121984:12345-0@lo:502:mount.lustre.0 Request processed in 93us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790947.503429:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787790947.503557:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268121984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790947.504308:0:17866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787790947.504320:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787790947.507458:0:17884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787790947.507477:0:17884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9170facf0000) 00000020:00000080:2.0:1787790947.507503:0:17884:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787790947.507653:0:17884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170ce839000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787790947.507657:0:17884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170ce839000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787790947.507660:0:17884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170ce839000 3 00010000:00080000:2.0:1787790947.507699:0:17884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f67c8800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787790947.511554:0:17884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787790947.511880:0:17884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787790947.511923:0:17884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787790947.511936:0:17884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf9477fddcf1ecd4 00000100:00080000:2.0:1787790947.511947:0:17884:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787790947.511954:0:17884:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9170f67c8800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790947.511990:0:17884:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe892c0 x1874634268122112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787790947.512697:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268122112:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790947.512782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787790947.512859:0:17884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787790947.512882:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.512887:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790947.512890:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790947.512893:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787790947.515737:0:17884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787790947.515875:0:17866:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787790947.515914:0:17866:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787790947.515934:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.515946:0:17866:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787790947.516008:0:17866:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787790947.516011:0:17866:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787790947.516013:0:17866:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790947.516014:0:17866:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790947.516015:0:17866:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790947.516017:0:17866:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790947.516019:0:17866:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790947.516021:0:17866:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790947.516022:0:17866:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787790947.516028:0:17866:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787790947.516031:0:17866:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787790947.516032:0:17866:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787790947.516033:0:17866:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790947.516034:0:17866:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790947.516035:0:17866:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790947.516036:0:17866:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790947.516037:0:17866:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790947.516038:0:17866:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790947.516039:0:17866:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787790947.516074:0:17866:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787790947.516096:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268122240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787790947.516172:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.516215:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbec59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790947.516326:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122240 00000100:00100000:3.0:1787790947.516332:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122240 00000100:00100000:3.0:1787790947.516374:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787790947.516383:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268122240:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787790947.516411:0:17128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787790947.516425:0:17128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787790947.521514:0:17114:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787790947.521559:0:17128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787790947.521575:0:17128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787790947.522069:0:17150:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790947.522075:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790947.522096:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522114:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 18 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522123:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522131:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522171:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522185:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790947.522200:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268122368:0@lo:104: 00000100:00100000:2.0:1787790947.522271:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790947.522318:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 18 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522327:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 18 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790947.522335:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268122496:0@lo:104: 00000100:00100000:2.0:1787790947.522355:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790947.522376:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbec5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790947.522417:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122368 00000100:00100000:2.0:1787790947.522425:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122368 00000100:00100000:2.0:1787790947.522461:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122496 00000100:00100000:2.0:1787790947.522464:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122496 00000100:00100000:2.0:1787790947.522477:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787790947.522485:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:17150:x1874634268122368:12345-0@lo:104: 00010000:00010000:2.0:1787790947.522497:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790947.522553:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790947.522559:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:17150:x1874634268122368:12345-0@lo:104: Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.522566:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787790947.522903:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790947.522911:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.522919:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787790947.522924:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.522943:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790947.522951:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790947.522957:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790947.522989:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.522995:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790947.523015:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.523023:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1eca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecaa expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.523034:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790947.523036:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790947.523038:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790947.523049:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122112 00000100:00100000:0.0:1787790947.523053:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122112 00000100:00100000:0.0:1787790947.523072:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790947.523077:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634268122112:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787790947.523096:0:17136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1787790947.523127:0:17136:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf9477fddcf1ece2 00000004:00100000:0.0:1787790947.523141:0:17136:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787790947.523170:0:17136:0:(import.c:65:import_set_state_nolock()) ffff916fc3934000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790947.523217:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874634268122112:12345-0@lo:38:llog_process_th.0 Request processed in 138us (10435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.523224:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790947.523341:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4594f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268122624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790947.523368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790947.524807:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790947.524823:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268122496:12345-0@lo:104: 00010000:00010000:3.0:1787790947.524837:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790947.524911:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787790947.524916:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268122496:12345-0@lo:104: Request processed in 100us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790947.524924:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790947.525159:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17866:x1874634268122240:12345-0@lo:253:mount.lustre.0 Request processed in 8776us (8986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790947.525169:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787790947.525218:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268122368:0@lo:104: 00000100:00100000:2.0:1787790947.525227:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268122496:0@lo:104: 00010000:00010000:2.0:1787790947.525259:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790947.525291:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17866:1874634268122240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787790947.525300:0:17866:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787790947.525303:0:17866:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787790947.525304:0:17866:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787790947.525306:0:17866:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790947.525307:0:17866:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790947.525308:0:17866:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790947.525314:0:17866:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790947.525315:0:17866:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787790947.525317:0:17866:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790947.525318:0:17866:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787790947.525329:0:17866:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787790947.525672:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122624 00000100:00100000:0.0:1787790947.525680:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122624 00010000:00010000:0.0:1787790947.525727:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790947.525751:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790947.525758:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268122624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790947.525770:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790947.525776:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525787:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525805:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995c00/0xcf9477fddcf1ecaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1eca3 expref: 18 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525816:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790947.525846:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:3641:x1874634268122624:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.525852:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787790947.525867:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790947.525872:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525892:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787790947.525896:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525904:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787790947.525911:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790947.525916:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787790947.525946:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525953:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787790947.525982:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.525988:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1ebdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ebe6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526001:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790947.526002:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790947.526004:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790947.526023:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4594f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268122624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790947.526025:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268122752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790947.526057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787790947.526058:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9170fbe892c0 x1874634268122112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790947.526070:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790947.526082:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787790947.526089:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787790947.526094:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787790947.526098:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787790947.526104:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268122112:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790947.526116:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122752 00000100:00100000:0.0:1787790947.526119:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122752 00010000:00010000:0.0:1787790947.526131:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 17 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790947.526149:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790947.526156:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:3638:x1874634268122752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790947.526163:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790947.526168:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 17 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526177:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 17 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526187:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ebe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ebdf expref: 17 pid: 17127 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526197:0:17121:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526206:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787790947.526219:0:17121:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005348064s 00010000:00010000:0.0:1787790947.526229:0:17121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526246:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526253:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526259:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526264:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790947.526267:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526274:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526297:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790947.526307:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790947.526334:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:3638:x1874634268122752:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.526340:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787790947.526365:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268122752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790947.526381:0:17150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790947.526388:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790947.526400:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995000/0xcf9477fddcf1ecdb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1787790947.544751:0:17866:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787790947.544993:0:17891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787790947.545248:0:17866:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787790947.545759:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17892:1874634268122880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787790947.545833:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790947.545866:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790947.546144:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268122880 00000100:00100000:1.0:1787790947.546150:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268122880 00000100:00100000:1.0:1787790947.546191:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790947.546201:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1874634268122880:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787790947.546285:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1874634268122880:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790947.546292:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1787790947.546579:0:17891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787790947.548667:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787790947.548772:0:17891:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787790947.548918:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17892:1874634268122880:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787790947.548958:0:17892:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787790947.549006:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17892:1874634268123008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787790947.549064:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790947.549095:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790947.549591:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123008 00000100:00100000:1.0:1787790947.549600:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123008 00000100:00100000:1.0:1787790947.549660:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790947.549671:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1874634268123008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787790947.549831:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1874634268123008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 161us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790947.549839:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1787790947.550162:0:17866:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787790947.550203:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787790947.550905:0:17866:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787790947.550914:0:17866:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787790947.550954:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790947.552208:0:17866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1787790947.552360:0:17890:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787790947.552366:0:17890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1787790947.554231:0:17866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787790947.554290:0:17866:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787790947.554391:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790947.554722:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17892:1874634268123008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787790947.554797:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17892:1874634268123136:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787790947.554856:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790947.554888:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2684900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.554966:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123136 00000100:00100000:0.0:1787790947.554971:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123136 00000100:00100000:0.0:1787790947.555023:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787790947.555032:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1874634268123136:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787790947.555079:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1874634268123136:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.555086:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787790947.555114:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9170fbebe1c0 x1874634268123136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787790963 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790947.555124:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17892:1874634268123136:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787790947.555168:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17892:1874634268123264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787790947.555194:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790947.555218:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123264 00000100:00100000:0.0:1787790947.555222:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123264 00000100:00100000:0.0:1787790947.555257:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790947.555263:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1874634268123264:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787790947.555314:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1874634268123264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790947.555336:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790947.555353:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790947.555365:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17892:1874634268123264:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787790947.555402:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787790947.557151:0:17866:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:0.0:1787790947.559697:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787790947.559816:0:17892:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787790947.559822:0:17892:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787790947.560326:0:17866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787790947.576826:0:17866:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787790947.576866:0:17866:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa8b3015df988 00100000:10000000:2.0:1787790947.576874:0:17866:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787790947.577440:0:17866:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787790947.577472:0:17866:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787790947.577490:0:17866:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787790947.577510:0:17866:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787790947.580850:0:17866:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790947.581087:0:17866:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787790947.594821:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790948.112565:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000040:00080000:3.0:1787790948.555332:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790948.618785:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787790949.066990:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790949.066998:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce839000 from 8 10000000:01000000:0.0:1787790949.067003:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790949.067047:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790949.067060:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790949.067070:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790949.067095:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790949.067188:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790949.068132:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2ba8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790949.068414:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123392 00000100:00100000:1.0:1787790949.068421:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123392 00000100:00100000:1.0:1787790949.068479:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787790949.068489:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:17131:x1874634268123392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790949.068504:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790949.068520:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ece9 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.068554:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 17 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.068565:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 17 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.068574:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbc00, rc 0) 00000100:00100000:1.0:1787790949.068629:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268123392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790949.068636:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790949.069078:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790949.069096:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790949.069105:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790949.069199:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787790949.069246:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790949.069283:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2ba8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790949.069392:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123520 00000100:00100000:1.0:1787790949.069397:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123520 00000100:00100000:1.0:1787790949.069421:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790949.069428:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268123520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787790949.069444:0:17128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787790949.069460:0:17128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787790949.069464:0:17128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787790949.069551:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268123520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790949.069566:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790949.069598:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787790949.069641:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787790949.069649:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.069657:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790949.069668:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787790949.069671:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff916fc46e5000 from 8 10000000:01000000:1.0:1787790949.069680:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787790949.069699:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.069732:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.069739:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790949.069751:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787790949.069775:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790949.069798:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2684240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790949.069808:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123648 00000100:00100000:1.0:1787790949.069810:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123648 00000100:00100000:1.0:1787790949.069827:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790949.069832:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268123648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790949.069844:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790949.070350:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ecf7 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.070426:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.070436:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.070444:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:1.0:1787790949.070483:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268123648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 650us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790949.070490:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790949.070536:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790949.070548:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.070557:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790949.070595:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787790949.070623:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790949.070636:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2684240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790949.070647:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123776 00000100:00100000:1.0:1787790949.070650:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123776 00000100:00100000:1.0:1787790949.070671:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787790949.070679:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268123776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787790949.070696:0:17128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787790949.070735:0:17128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787790949.070739:0:17128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787790949.070803:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268123776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790949.070811:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787790949.070836:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268123776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787790949.070869:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787790949.070875:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790949.070882:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790949.131270:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000040:00080000:3.0:1787790949.580162:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787790949.643469:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790950.154776:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790950.667086:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790951.188297:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00000001:02000400:0.0:1787790951.414525:0:18135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787790951.691614:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787790952.190921:0:18187:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790952.191125:0:18187:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787790952.203250:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 0 seconds 00010000:00010000:0.0:1787790952.718473:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790952.778844:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787790952.778851:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787790952.778855:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790952.778867:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9170eef42800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790952.778891:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe8b480 x1874634268124032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790952.778908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790952.778917:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790952.778920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790952.778923:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790952.778949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790952.778952:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790952.778955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790952.778958:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787790952.778998:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268124032:0@lo:38:kworker.0 00000100:00100000:2.0:1787790952.779065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.779128:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268124160:0@lo:400:kworker.0 00000100:00100000:2.0:1787790952.779156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.779177:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790952.779182:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268124288:0@lo:400:kworker.0 00000100:00100000:2.0:1787790952.779221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.779253:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124032 00000100:00100000:2.0:1787790952.779259:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124032 00000100:00100000:2.0:1787790952.779280:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124288 00000100:00100000:2.0:1787790952.779282:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124288 00000100:00100000:2.0:1787790952.779376:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790952.779383:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268124032:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787790952.779407:0:17140:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1787790952.779440:0:17140:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1ed05 00000004:00100000:2.0:1787790952.779453:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787790952.779458:0:17140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787790952.779531:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124160 00000100:00100000:2.0:1787790952.779535:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124160 00000100:00100000:2.0:1787790952.779560:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790952.779567:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268124160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790952.779616:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268124160:12345-0@lo:400:kworker.0 Request processed in 49us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790952.779624:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787790952.779673:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbe8ad00 x1874634268124160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790952.779687:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268124160:0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.779802:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268123904:0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.779837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790952.779863:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790952.779869:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268124416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.779890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790952.779915:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124416 00000100:00100000:0.0:1787790952.779919:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124416 00000100:00100000:0.0:1787790952.779946:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790952.779951:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.779984:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268124416:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790952.779990:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787790952.780020:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbe8a940 x1874634268124416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790952.780030:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268124416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.780212:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790952.780219:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268124544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790952.780252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790952.780276:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787790952.780283:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787790952.780438:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268123904 00000100:00100000:2.0:1787790952.780442:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268123904 00000100:00100000:2.0:1787790952.780479:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787790952.780486:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3639:x1874634268123904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790952.780528:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3639:x1874634268123904:12345-0@lo:400:kworker.0 Request processed in 42us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790952.780534:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787790952.780599:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268123904:0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.780955:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124544 00000100:00100000:0.0:1787790952.780960:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124544 00000100:00100000:1.0:1787790952.781081:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790952.781089:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268124288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790952.781140:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268124288:12345-0@lo:400:kworker.0 Request processed in 52us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790952.781146:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787790952.781160:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790952.781167:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268124544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790952.781204:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787790952.781251:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268124544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790952.781266:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790952.781505:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268124288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790952.781568:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268124544:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787790952.791619:0:17140:0:(import.c:65:import_set_state_nolock()) ffff916fc3936800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790952.791750:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634268124032:12345-0@lo:38:kworker.0 Request processed in 12364us (12682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790952.791762:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787790952.792413:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787790952.792423:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787790952.792427:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787790952.792430:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787790952.792449:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002e6250a7): req@ffff9170ff5ada40 x1874634268117120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790952.792472:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268124032:0@lo:38:kworker.0 00000100:00100000:0.0:1787790952.792506:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790952.792521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268124672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790952.792566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.793047:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124672 00000100:00100000:2.0:1787790952.793054:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124672 00000100:00100000:2.0:1787790952.793110:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790952.793120:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268124672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790952.793148:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790952.793202:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268124672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790952.793209:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790952.793284:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4596d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268124672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790952.793869:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.793886:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790952.793897:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268117120 00000100:00100000:2.0:1787790952.793901:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268117120 00000100:00100000:2.0:1787790952.793921:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790952.793926:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17176:x1874634268117120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787790952.793994:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17176:x1874634268117120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790952.793999:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790952.794018:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17176:1874634268117120:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787790952.794045:0:17176:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787790952.794076:0:17176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17176:1874634268124800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787790952.794096:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.794113:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790952.794121:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124800 00000100:00100000:2.0:1787790952.794123:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124800 00000100:00100000:2.0:1787790952.794134:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790952.794138:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17176:x1874634268124800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787790952.794245:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17176:x1874634268124800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790952.794250:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790952.794268:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17176:1874634268124800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787790952.794327:0:17176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17176:1874634268124928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787790952.794342:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790952.794352:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc1c9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787790952.794360:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268124928 00000100:00100000:2.0:1787790952.794362:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268124928 00000100:00100000:2.0:1787790952.794374:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790952.794378:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17176:x1874634268124928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787790952.794407:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17176:x1874634268124928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 29us (63us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790952.794411:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790952.794425:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17176:1874634268124928:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787790952.794464:0:17176:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790952.799006:0:17176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787790952.799078:0:17176:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1787790952.799082:0:17176:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1787790952.962645:0:18238:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790952.962923:0:18238:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787790953.738841:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787790953.954331:0:18287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc71015c40 20000000:00000080:0.0:1787790953.954351:0:18287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9170f5a55000 uarg=0000000000000000 20000000:01000000:0.0:1787790953.954394:0:18287:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787790953.954402:0:18287:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787790953.954408:0:18287:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787790953.954929:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787790953.955138:0:18287:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787790953.959272:0:18287:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787790953.959422:0:18287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.959445:0:18287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 17 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.959453:0:18287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.959460:0:18287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.959509:0:18287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.959525:0:18287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 17 pid: 17128 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790953.959541:0:18287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1874634268125056:0@lo:104: 00000100:00100000:1.0:1787790953.959613:0:18287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790953.959675:0:18287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 17 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.959682:0:18287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 17 pid: 17129 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790953.959689:0:18287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1874634268125184:0@lo:104: 00000100:00100000:1.0:1787790953.959733:0:18287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790953.959766:0:18287:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed8cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790953.959838:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125056 00000100:00100000:2.0:1787790953.959845:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125056 00000100:00100000:2.0:1787790953.959887:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125184 00000100:00100000:2.0:1787790953.959889:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125184 00000100:00100000:2.0:1787790953.959901:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790953.959909:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:18287:x1874634268125056:12345-0@lo:104: 00010000:00010000:2.0:1787790953.959926:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.959977:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790953.959983:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:18287:x1874634268125056:12345-0@lo:104: Request processed in 75us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790953.959990:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790953.960076:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787790953.960083:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:18287:x1874634268125184:12345-0@lo:104: 00010000:00010000:2.0:1787790953.960090:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960122:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790953.960127:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:18287:x1874634268125184:12345-0@lo:104: Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790953.960132:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787790953.960146:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790953.960151:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960158:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790953.960161:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960170:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790953.960177:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790953.960201:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790953.960230:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960236:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790953.960252:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960259:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3995600/0xcf9477fddcf1ecb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecb8 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960272:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790953.960275:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960280:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790953.960283:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960290:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790953.960296:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790953.960302:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790953.960311:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960316:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790953.960401:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960408:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1ebae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ebb5 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790953.960421:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790953.960423:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790953.960424:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790953.960440:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790953.960450:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268125440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790953.960479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787790953.960568:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790953.960579:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268125312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790953.960605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790953.960638:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125440 00000100:00100000:0.0:1787790953.960642:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125440 00010000:00010000:0.0:1787790953.960667:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 18 pid: 17129 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790953.960685:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125312 00000100:00100000:0.0:1787790953.960687:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125312 00010000:00010000:0.0:1787790953.960696:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 19 pid: 17128 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790953.960725:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790953.960731:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:3639:x1874634268125440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790953.960741:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790953.960746:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 19 pid: 17129 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960754:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 19 pid: 17129 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960769:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790953.960793:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:3639:x1874634268125440:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790953.960799:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790953.960811:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790953.960817:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268125312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787790953.960823:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790953.960827:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 18 pid: 17128 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960836:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 18 pid: 17128 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960857:0:17121:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960865:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960878:0:17121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960885:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960892:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960898:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960903:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790953.960907:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960913:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960921:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790953.960929:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790953.960951:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268125312:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790953.960964:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790953.961389:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268125312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787790953.961427:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268125440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790953.961498:0:18287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ecb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ecb1 expref: 17 pid: 17128 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790953.961510:0:18287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1874634268125056:0@lo:104: 00010000:00010000:1.0:1787790953.961517:0:18287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad5200/0xcf9477fddcf1ebb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ebae expref: 16 pid: 17129 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790953.961525:0:18287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1874634268125184:0@lo:104: 00010000:00010000:1.0:1787790953.961540:0:18287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.961548:0:18287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.961555:0:18287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790953.961562:0:18287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1ed0c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790954.762967:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787790955.211940:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790955.787466:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787790955.854585:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790955.854605:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170ce839000 from 13 10000000:01000000:3.0:1787790955.854611:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790955.854664:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790955.854676:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790955.854686:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790955.854728:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790955.854806:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790955.854993:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125568 00000100:00100000:1.0:1787790955.855001:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125568 00000100:00100000:1.0:1787790955.855054:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787790955.855064:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+16:17131:x1874634268125568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790955.855078:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790955.855093:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ed13 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790955.855118:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 17 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790955.855143:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 17 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790955.855152:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa200, rc 0) 00000100:00100000:1.0:1787790955.855199:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268125568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790955.855206:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787790955.859810:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc26849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790955.859855:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790955.859883:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790955.859912:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790955.860007:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790955.860069:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790955.860100:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc26849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790955.860237:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125696 00000100:00100000:0.0:1787790955.860243:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125696 00000100:00100000:0.0:1787790955.860299:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790955.860319:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268125696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.860452:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268125696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790955.860461:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790955.860514:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.860553:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.860594:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790955.860628:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c5508900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790955.860642:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125824 00000100:00100000:0.0:1787790955.860645:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125824 00000100:00100000:0.0:1787790955.860665:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790955.860671:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268125824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.860765:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268125824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790955.860772:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790955.860813:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787790955.861483:0:18369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787790955.861537:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787790955.861555:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790955.861563:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861574:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790955.861583:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790955.861585:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff916fc46e5000 from 13 10000000:01000000:0.0:1787790955.861587:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790955.861613:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861621:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861630:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790955.861646:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.861680:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790955.861726:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c5508300 going to sleep for 11 seconds 00000100:00100000:0.0:1787790955.861739:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268125952 00000100:00100000:0.0:1787790955.861743:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268125952 00000100:00100000:0.0:1787790955.861769:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790955.861776:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+17:17131:x1874634268125952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790955.861784:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790955.861803:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ed21 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861825:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861836:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861843:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4600, rc 0) 00000100:00100000:0.0:1787790955.861872:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268125952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790955.861878:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790955.861914:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268125952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790955.861926:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.861934:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790955.861973:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268126080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.861996:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790955.862012:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c5508300 going to sleep for 11 seconds 00000100:00100000:0.0:1787790955.862022:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268126080 00000100:00100000:0.0:1787790955.862025:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268126080 00000100:00100000:0.0:1787790955.862045:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787790955.862051:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268126080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.862125:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268126080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790955.862139:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787790955.862184:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268126080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.862207:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268126208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.862240:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790955.862253:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c5508300 going to sleep for 11 seconds 00000100:00100000:0.0:1787790955.862263:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268126208 00000100:00100000:0.0:1787790955.862266:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268126208 00000100:00100000:0.0:1787790955.862286:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787790955.862292:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268126208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790955.862357:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:17131:x1874634268126208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790955.862363:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787790955.862399:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4597c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268126208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787790955.863091:0:18370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787790955.863134:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787790955.863151:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790955.863158:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790955.864499:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790956.812006:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790957.839419:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790957.904601:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790947/real 1787790947] req@ffff9170ff5ad680 x1874634268120320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790957 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790957.904631:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170ff5ad680 x1874634268120320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790957 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790957.904656:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790947/real 1787790947] req@ffff9170ff5aed00 x1874634268120064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790957 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790957.904671:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170ff5aed00 x1874634268120064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790957 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787790957.904693:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790957.909768:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787790957.909779:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268120320:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787790957.909840:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268126336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790957.909974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790957.910043:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268126336 00000100:00100000:0.0:1787790957.910050:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268126336 00000100:00100000:0.0:1787790957.910098:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790957.910107:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4594b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268126336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787790957.910151:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787790957.910199:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4594b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268126336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790957.910207:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787790957.910255:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268126336:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787790957.910274:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790957.910281:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787790957.910284:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268120064:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787790957.910617:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268126464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790957.910654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790957.910690:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268126464 00000100:00100000:0.0:1787790957.910694:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268126464 00000100:00100000:0.0:1787790957.910737:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790957.910745:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268126464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787790957.910764:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787790957.910810:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268126464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790957.910817:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790957.910845:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268126464:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787790957.917098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790957.917106:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790957.917108:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790957.917111:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790957.917133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790957.917136:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787790957.917140:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790957.917160:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1787790957.917166:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787790957.917173:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170d614d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790957.917191:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268126720:0@lo:400:kworker.0 00000100:00100000:1.0:1787790957.917266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790957.917442:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268126592:0@lo:400:kworker.0 00000100:00100000:0.0:1787790957.917477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790957.917539:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268126592 00000100:00100000:0.0:1787790957.917546:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268126592 00000100:00100000:0.0:1787790957.917597:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787790957.917606:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268126592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790957.917660:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268126592:12345-0@lo:400:kworker.0 Request processed in 55us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790957.917667:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787790957.917739:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268126592:0@lo:400:kworker.0 00000100:00100000:1.0:1787790957.919356:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268126720 00000100:00100000:1.0:1787790957.919367:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268126720 00000100:00100000:1.0:1787790957.919405:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787790957.919413:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268126720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790957.919481:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268126720:12345-0@lo:400:kworker.0 Request processed in 68us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790957.919488:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787790957.919524:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbebc780 x1874634268126720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790957.919537:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268126720:0@lo:400:kworker.0 00000100:00100000:1.0:1787790957.919579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebc780 x1874634268126848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790957.919597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790957.919601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787790957.919604:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790957.919608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1787790957.919611:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787790957.919615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170d6153000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790957.919626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebe940 x1874634268126976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790957.919653:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790957.919661:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268127104:0@lo:400:kworker.0 00000100:00100000:1.0:1787790957.919694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790957.919735:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268127104 00000100:00100000:1.0:1787790957.919739:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268127104 00000100:00100000:1.0:1787790957.919760:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790957.919766:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268127104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790957.919809:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268127104:12345-0@lo:400:kworker.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790957.919825:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787790957.919852:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbebd680 x1874634268127104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790957.919861:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268127104:0@lo:400:kworker.0 00000100:00100000:0.0:1787790957.920106:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268126848:0@lo:8:kworker.0 00000400:00000100:0.0:1787790957.920130:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268126848 offset 0 length 520: 4 00000100:00100000:0.0:1787790957.920159:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268126976:0@lo:8:kworker.0 00000400:00000100:0.0:1787790957.920177:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268126976 offset 0 length 520: 4 00010000:00010000:2.0:1787790958.859838:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790958.924423:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790943/real 1787790943] req@ffff9170ff5af0c0 x1874634268118144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790958.924452:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170ff5af0c0 x1874634268118144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790958.924462:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790943/real 1787790943] req@ffff9170ff5ad2c0 x1874634268118272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790958.924473:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170ff5ad2c0 x1874634268118272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787790958.924503:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790958.924512:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787790958.924516:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268118144:0@lo:8:kworker.0 00000100:00080000:0.0:1787790958.924522:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790958.924527:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787790958.924530:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268118272:0@lo:8:kworker.0 00000001:00100000:0.0:1787790958.928435:0:17867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1787790958.929801:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790958.929806:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787790958.929810:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790958.929818:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1787790958.929824:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787790958.929830:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170d6142800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790958.929851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe8b840 x1874634268127488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787790958.929866:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790958.929869:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787790958.929871:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787790958.929874:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1787790958.929877:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787790958.929895:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170d6145800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787790958.929909:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe8b0c0 x1874634268127616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790958.929925:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268127360:0@lo:400:kworker.0 00000100:00080000:2.0:1787790958.929948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790958.929953:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790958.929955:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790958.929958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787790958.930020:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268127872:0@lo:400:kworker.0 00000100:00100000:1.0:1787790958.930021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790958.930075:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787790958.930082:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268127232:0@lo:400:kworker.0 00000100:00100000:0.0:1787790958.931782:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268127488:0@lo:8:kworker.0 00000100:00100000:2.0:1787790958.935225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790958.935268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790958.935319:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268127360 00000100:00100000:3.0:1787790958.935329:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268127360 00000100:00100000:3.0:1787790958.935376:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268127872 00000100:00100000:3.0:1787790958.935380:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268127872 00000100:00100000:3.0:1787790958.935396:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787790958.935405:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268127360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790958.935461:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268128000:0@lo:400:kworker.0 00000100:00100000:3.0:1787790958.935484:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268127360:12345-0@lo:400:kworker.0 Request processed in 79us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790958.935493:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787790958.935501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790958.935513:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787790958.935523:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268127872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790958.935541:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268127360:0@lo:400:kworker.0 00000100:00100000:3.0:1787790958.935571:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268127872:12345-0@lo:400:kworker.0 Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790958.935579:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268127744:0@lo:400:kworker.0 00000100:00100000:3.0:1787790958.935580:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787790958.935612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790958.936649:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268127232 00000100:00100000:1.0:1787790958.936657:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268127232 00000100:00100000:1.0:1787790958.936696:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787790958.936718:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268127232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790958.936765:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:3641:x1874634268127232:12345-0@lo:400:kworker.0 Request processed in 61us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790958.936771:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000400:00000100:0.0:1787790958.936977:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268127488 offset 0 length 520: 4 00000100:00100000:0.0:1787790958.936995:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268127616:0@lo:8:kworker.0 00000400:00000100:0.0:1787790958.937019:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268127616 offset 0 length 520: 4 00000100:00100000:0.0:1787790958.937105:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268127232:0@lo:400:kworker.0 00000100:00100000:3.0:1787790958.937179:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128000 00000100:00100000:3.0:1787790958.937184:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128000 00000100:00100000:3.0:1787790958.937219:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268127744 00000100:00100000:3.0:1787790958.937222:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268127744 00000100:00100000:3.0:1787790958.937236:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787790958.937242:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268128000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790958.937397:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790958.937406:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787790958.937543:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787790958.937557:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790958.937952:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268127744:12345-0@lo:400:kworker.0 Request processed in 396us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790958.937960:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787790958.938812:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc4461680 x1874634268127744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790958.938826:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268127744:0@lo:400:kworker.0 00000100:00100000:2.0:1787790958.947956:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268127872:0@lo:400:kworker.0 00000100:00100000:3.0:1787790958.948119:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268128000:12345-0@lo:400:kworker.0 Request processed in 10873us (12615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790958.948132:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787790958.948215:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc4462940 x1874634268128000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790958.948229:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268128000:0@lo:400:kworker.0 00000040:00080000:0.0:1787790959.819343:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790959.884348:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790960.907865:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787790961.198988:0:18636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787790961.198993:0:18636:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787790961.198994:0:18636:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787790961.199112:0:18636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170f67ce800 00000020:01000004:2.0:1787790961.199141:0:18636:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787790961.199155:0:18636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787790961.199169:0:18636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9170facf19b8) 00000020:00000080:2.0:1787790961.199187:0:18636:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787790961.269015:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787790961.271253:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787790961.273729:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787790961.274227:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787790961.275100:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787790961.276282:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787790961.277877:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787790961.281172:0:18636:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787790961.281672:0:18636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787790961.281685:0:18636:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787790961.281698:0:18636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf9477fddcf1ed36 00000020:01000004:3.0:1787790961.281939:0:18636:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787790961.281963:0:18636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787790961.281966:0:18636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787790961.281972:0:18636:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787790961.281977:0:18636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787790961.281989:0:18636:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9170eef53370) 00000020:00000080:3.0:1787790961.282001:0:18636:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787790961.287240:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787790961.288035:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787790961.288041:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787790961.291065:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787790961.291077:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787790961.294988:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787790961.294999:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787790961.303044:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787790961.303238:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787790961.303243:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787790961.305965:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787790961.305975:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787790961.344227:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790961.344571:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787790961.344577:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787790961.347598:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787790961.347617:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787790961.349188:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787790961.349198:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787790961.351543:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790961.351976:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787790961.351983:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787790961.352673:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787790961.352679:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787790961.389363:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787790961.389659:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787790961.389665:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787790961.391378:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787790961.391495:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787790961.392144:0:18636:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787790961.392171:0:18636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787790961.392178:0:18636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787790961.403202:0:18636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787790961.403311:0:18636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787790961.403316:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787790961.403318:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790961.403320:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790961.403326:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790961.403328:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790961.403329:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790961.403330:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790961.403332:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790961.403333:0:18636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790961.403337:0:18636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787790961.403339:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790961.403340:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790961.403341:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790961.403342:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790961.403343:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790961.403344:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790961.403345:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790961.403346:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790961.403347:0:18636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790961.403381:0:18636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787790961.403506:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787790961.403572:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.403650:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.403686:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128128 00000100:00100000:0.0:1787790961.403698:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128128 00000100:00100000:0.0:1787790961.404000:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787790961.404010:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:18636:x1874634268128128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787790961.404039:0:17129:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787790961.404042:0:17129:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787790961.404045:0:17129:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787790961.404335:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:18636:x1874634268128128:12345-0@lo:253:mount.lustre.0 Request processed in 325us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.404345:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787790961.404476:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787790961.404486:0:18636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787790961.404488:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787790961.404489:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790961.404490:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790961.404492:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790961.404493:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790961.404494:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790961.404495:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790961.404497:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790961.404498:0:18636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787790961.404516:0:18636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170f67ce800 from lustre-OST0000 10000000:01000000:3.0:1787790961.404548:0:18636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787790961.404551:0:18636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787790961.404558:0:18636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9170fc134d28 local copy 00010000:00010000:3.0:1787790961.404568:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.404643:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790961.404669:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.405013:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.405095:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128256 00000100:00100000:1.0:1787790961.405100:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128256 00000100:00100000:1.0:1787790961.405140:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787790961.405147:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:18636:x1874634268128256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790961.405214:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:18636:x1874634268128256:12345-0@lo:501:mount.lustre.0 Request processed in 67us (543us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790961.405221:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787790961.405338:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128256:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787790961.405351:0:18636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787790961.405367:0:18636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787790961.405373:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.405382:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790961.405507:0:18636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170f67ce800 10000000:01000000:3.0:1787790961.405512:0:18636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787790961.405517:0:18636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787790961.405520:0:18636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787790961.405524:0:18636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787790961.405526:0:18636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787790961.405547:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.405556:0:18636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.405565:0:18636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.405588:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787790961.405612:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.405633:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.405676:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128384 00000100:00100000:1.0:1787790961.405680:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128384 00000100:00100000:1.0:1787790961.405697:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787790961.405725:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+18:18636:x1874634268128384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790961.405911:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790961.405924:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fac00/0xcf9477fddcf1ed4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ed44 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.405944:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fac00/0xcf9477fddcf1ed4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed44 expref: 19 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.405954:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fac00/0xcf9477fddcf1ed4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed44 expref: 19 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.405963:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fac00, rc 0) 00000100:00100000:1.0:1787790961.405998:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128384:12345-0@lo:101:mount.lustre.0 Request processed in 295us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.406004:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787790961.406068:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790961.406080:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.406089:0:18636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790961.407163:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787790961.407983:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790961.411015:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787790961.411064:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787790961.411077:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787790961.411089:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787790961.411101:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787790961.411132:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787790961.411171:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787790961.411177:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787790961.412094:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790961.412170:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.412207:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.412313:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128512 00000100:00100000:1.0:1787790961.412320:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128512 00000100:00100000:1.0:1787790961.412500:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787790961.412511:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790961.412658:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128512:12345-0@lo:501:mount.lustre.0 Request processed in 149us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.412672:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787790961.412848:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790961.412883:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790961.412918:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.413023:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.413091:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128640 00000100:00100000:0.0:1787790961.413096:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128640 00000100:00100000:0.0:1787790961.413127:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787790961.413134:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790961.413860:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128640:12345-0@lo:503:mount.lustre.0 Request processed in 725us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.413868:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787790961.414011:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787790961.414362:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790961.414551:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.414587:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.414616:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.414661:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128768 00000100:00100000:0.0:1787790961.414665:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128768 00000100:00100000:0.0:1787790961.414685:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787790961.414690:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790961.415125:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128768:12345-0@lo:502:mount.lustre.0 Request processed in 433us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.415133:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787790961.415224:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.415379:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787790961.415568:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787790961.415581:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787790961.415595:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787790961.415606:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787790961.415618:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787790961.415629:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787790961.415640:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787790961.415653:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787790961.415669:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787790961.415680:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787790961.415691:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787790961.415868:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.415905:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.415934:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.415979:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268128896 00000100:00100000:0.0:1787790961.415983:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268128896 00000100:00100000:0.0:1787790961.416002:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787790961.416008:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790961.416082:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268128896:12345-0@lo:502:mount.lustre.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.416089:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787790961.416166:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268128896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.416199:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787790961.416206:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787790961.417129:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787790961.417137:0:18653:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787790961.417144:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.417146:0:18653:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787790961.417151:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787790961.417170:0:18653:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff916fc45f99b8) 00000020:00000080:0.0:1787790961.417191:0:18653:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787790961.417196:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787790961.417321:0:18653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f67ce800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787790961.417330:0:18653:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787790961.417337:0:18653:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf9477fddcf1ed59 00010000:00010000:1.0:1787790961.422155:0:18653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787790961.423000:0:18653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787790961.424630:0:18653:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787790961.426585:0:18653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787790961.426595:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790961.426601:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.426603:0:18653:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787790961.426606:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787790961.426609:0:18653:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787790961.426610:0:18653:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790961.426612:0:18653:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787790961.426613:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787790961.426616:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.426617:0:18653:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787790961.426620:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790961.426623:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.426624:0:18653:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787790961.426626:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787790961.426628:0:18653:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787790961.426630:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790961.426631:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.426638:0:18653:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787790961.426640:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787790961.426643:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.426644:0:18653:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787790961.426647:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787790961.426677:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787790961.426679:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787790961.426681:0:18653:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787790961.426684:0:18653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787790961.426992:0:18636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787790961.427023:0:18636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787790961.427043:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.427056:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790961.427064:0:18636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f67ce800 from 1 10000000:01000000:1.0:1787790961.427067:0:18636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787790961.427101:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.427109:0:18636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.427131:0:18636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790961.427154:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790961.427220:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790961.427253:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0c1c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.427534:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129024 00000100:00100000:0.0:1787790961.427540:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129024 00000100:00100000:0.0:1787790961.427585:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787790961.427593:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:18636:x1874634268129024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787790961.427605:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790961.427616:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ed60 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790961.427639:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 20 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790961.427649:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 20 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790961.427658:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4800, rc 0) 00000100:00100000:0.0:1787790961.427721:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129024:12345-0@lo:101:mount.lustre.0 Request processed in 111us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790961.427880:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790961.427895:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.427905:0:18636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790961.428248:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000040:00080000:2.0:1787790961.429180:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787790961.429543:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790961.429898:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787790961.429922:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787790961.429938:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787790961.429942:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787790961.430003:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790961.430053:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790961.430087:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.430206:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129152 00000100:00100000:0.0:1787790961.430212:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129152 00000100:00100000:0.0:1787790961.430265:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787790961.430274:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790961.430372:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129152:12345-0@lo:501:mount.lustre.0 Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.430380:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787790961.430575:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790961.430602:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787790961.430636:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790961.430697:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.434063:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129280 00000100:00100000:0.0:1787790961.434074:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129280 00000100:00100000:0.0:1787790961.434124:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787790961.434134:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790961.434283:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129280:12345-0@lo:503:mount.lustre.0 Request processed in 150us (3645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.434290:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787790961.435521:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787790961.436253:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790961.436349:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.436530:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.436570:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790961.436865:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129408 00000100:00100000:2.0:1787790961.436871:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129408 00000100:00100000:2.0:1787790961.436912:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787790961.436920:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790961.437012:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129408:12345-0@lo:502:mount.lustre.0 Request processed in 92us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790961.437019:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787790961.437370:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.437647:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787790961.437671:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787790961.437684:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787790961.437695:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787790961.437725:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787790961.438945:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787790961.438964:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787790961.438975:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787790961.438987:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787790961.438998:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787790961.439010:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787790961.439044:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.439100:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.439147:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.439200:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129536 00000100:00100000:1.0:1787790961.439205:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129536 00000100:00100000:1.0:1787790961.439248:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787790961.439375:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790961.439535:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129536:12345-0@lo:502:mount.lustre.0 Request processed in 162us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790961.439887:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.439936:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787790961.439944:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787790961.442861:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790961.442876:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.442878:0:18657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787790961.442887:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f67ce800 00000020:00000080:3.0:1787790961.442889:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790961.442896:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790961.442899:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.442900:0:18657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787790961.442908:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790961.442910:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.442911:0:18657:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787790961.442914:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f67ce800 00000020:00000080:3.0:1787790961.442915:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787790961.443100:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:01000000:3.0:1787790961.443953:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790961.443959:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.443961:0:18657:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787790961.443965:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790961.443967:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.443969:0:18657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790961.443972:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f67ce800 00000020:00000080:3.0:1787790961.443974:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790961.448599:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790961.448612:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.448614:0:18657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790961.448619:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790961.448624:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.448625:0:18657:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787790961.448630:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f67ce800 00000020:00000080:3.0:1787790961.448632:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790961.448691:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790961.448694:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790961.448695:0:18657:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787790961.448699:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787790961.448954:0:18636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787790961.448988:0:18636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790961.449009:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.449021:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790961.449079:0:18636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787790961.449081:0:18636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170f67ce800 10000000:01000000:3.0:1787790961.449085:0:18636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170f67ce800 10000000:01000000:3.0:1787790961.449089:0:18636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787790961.449094:0:18636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f67ce800 from 1 10000000:01000000:3.0:1787790961.449097:0:18636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787790961.449143:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.449151:0:18636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.449162:0:18636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.449187:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787790961.449253:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.449354:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129664 00000100:00100000:3.0:1787790961.449359:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129664 00000100:00100000:3.0:1787790961.449511:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787790961.449521:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:18636:x1874634268129664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790961.449534:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790961.449546:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4538600/0xcf9477fddcf1ed75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ed6e expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.449566:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4538600/0xcf9477fddcf1ed75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed6e expref: 21 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.449587:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4538600/0xcf9477fddcf1ed75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed6e expref: 21 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.449596:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538600, rc 0) 00000100:00100000:3.0:1787790961.449626:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268129664:12345-0@lo:101:mount.lustre.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790961.449634:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787790961.449674:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790961.449693:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790961.450869:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.450884:0:18636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790961.453882:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787790961.454155:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790961.456364:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787790961.456578:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787790961.456594:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787790961.456607:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787790961.456618:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787790961.456629:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787790961.456641:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787790961.456656:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787790961.456667:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787790961.456678:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787790961.456689:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787790961.458348:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787790961.458602:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787790961.458620:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787790961.458633:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787790961.458646:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787790961.458660:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787790961.458689:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787790961.459154:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787790961.459180:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787790961.459201:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787790961.459221:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787790961.459240:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787790961.459260:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787790961.459278:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787790961.459294:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787790961.459311:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787790961.459328:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787790961.459345:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787790961.459463:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787790961.459479:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787790961.459491:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787790961.459504:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787790961.459643:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787790961.459664:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787790961.459679:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787790961.459695:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787790961.459740:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787790961.459746:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787790961.459857:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790961.459925:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790961.459959:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129792 00000100:00100000:3.0:1787790961.459967:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.459968:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129792 00000100:00100000:1.0:1787790961.460063:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787790961.460073:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268129792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790961.460209:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268129792:12345-0@lo:501:mount.lustre.0 Request processed in 136us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.460219:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787790961.460300:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790961.460340:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790961.460377:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.460514:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268129920 00000100:00100000:3.0:1787790961.460518:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268129920 00000100:00100000:3.0:1787790961.460549:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787790961.460558:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268129920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790961.460633:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268129920:12345-0@lo:503:mount.lustre.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790961.460641:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787790961.460682:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790961.460698:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268129920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787790961.461244:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787790961.461305:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268130048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.461349:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.461382:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130048 00000100:00100000:3.0:1787790961.461500:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130048 00000100:00100000:3.0:1787790961.461538:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790961.461547:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268130048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.461635:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268130048:12345-0@lo:502:mount.lustre.0 Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790961.461643:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787790961.461842:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790961.461866:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268130048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.462025:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787790961.462055:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787790961.462085:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787790961.462102:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787790961.462137:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787790961.462156:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787790961.462172:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787790961.462189:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787790961.462205:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787790961.462234:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787790961.462253:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787790961.462270:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787790961.462287:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787790961.462303:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787790961.462320:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787790961.462337:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787790961.462354:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787790961.462368:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787790961.462379:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787790961.462868:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787790961.462889:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787790961.462901:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787790961.462914:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787790961.462925:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787790961.462937:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787790961.462960:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787790961.462973:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787790961.462984:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787790961.462996:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787790961.463007:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787790961.463018:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787790961.463030:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787790961.463040:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787790961.463052:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787790961.463064:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787790961.463083:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787790961.463095:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787790961.463106:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787790961.463131:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787790961.463144:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787790961.463157:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787790961.463180:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787790961.463195:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787790961.463210:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787790961.463223:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787790961.463234:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787790961.463246:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787790961.463257:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787790961.463297:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268130176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.463354:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.464545:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787790961.466261:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130176 00000100:00100000:0.0:1787790961.466273:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130176 00000100:00100000:0.0:1787790961.466325:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787790961.466335:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268130176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790961.466480:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268130176:12345-0@lo:502:mount.lustre.0 Request processed in 146us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.466488:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787790961.466522:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268130176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.466894:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1787790961.466928:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1787790961.466960:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268130304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790961.467003:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.467066:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.467103:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130304 00000100:00100000:1.0:1787790961.467107:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130304 00000100:00100000:1.0:1787790961.467172:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787790961.467180:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268130304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790961.467252:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268130304:12345-0@lo:502:mount.lustre.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.467260:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787790961.467313:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268130304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787790961.467346:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1787790961.467353:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787790961.468853:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787790961.468870:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff916fc45f8000) 00000020:00000080:0.0:1787790961.468892:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787790961.468972:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f67ce800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787790961.468977:0:18662:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f67ce800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787790961.468980:0:18662:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67ce800 3 00010000:00080000:0.0:1787790961.469022:0:18662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc1dd4800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790961.473918:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787790961.474156:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787790961.474207:0:18662:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787790961.474222:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf9477fddcf1ed83 00000100:00080000:1.0:1787790961.474233:0:18662:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790961.474239:0:18662:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc1dd4800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790961.474286:0:18662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebe1c0 x1874634268130432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790961.474340:0:18662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787790961.474380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.474385:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787790961.474510:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268130432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790961.474574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790961.474639:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268130560:0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.474668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.474700:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130560 00000100:00100000:3.0:1787790961.474723:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130560 00000100:00100000:0.0:1787790961.474736:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130432 00000100:00100000:0.0:1787790961.474741:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130432 00000100:00100000:0.0:1787790961.474766:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790961.474772:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268130432:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787790961.474793:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1787790961.474820:0:17135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf9477fddcf1ed8a 00000004:00100000:0.0:1787790961.474834:0:17135:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787790961.474862:0:17135:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790961.474903:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874634268130432:12345-0@lo:38:llog_process_th.0 Request processed in 129us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.474910:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787790961.474943:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbebe1c0 x1874634268130432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790961.474952:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790961.474959:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787790961.474965:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787790961.474969:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787790961.474972:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787790961.474978:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268130432:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787790961.475051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.475055:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790961.475098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.475101:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790961.475104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.475107:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787790961.475190:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787790961.475197:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268130560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790961.475239:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268130560:12345-0@lo:400:kworker.0 Request processed in 42us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790961.475246:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790961.475781:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268130688:0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.475810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790961.475828:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790961.475833:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268130816:0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.475860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790961.475884:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268130944:0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.475903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790961.475937:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268130560:0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.475956:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130688 00000100:00100000:0.0:1787790961.475959:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130688 00000100:00100000:0.0:1787790961.475980:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130944 00000100:00100000:0.0:1787790961.475983:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130944 00000100:00100000:0.0:1787790961.476007:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790961.476013:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4597c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268130688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.476062:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4597c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268130688:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.476069:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790961.476079:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268130816 00000100:00100000:3.0:1787790961.476085:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268130816 00000100:00100000:0.0:1787790961.476085:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787790961.476096:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268130944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790961.476124:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787790961.476133:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4596d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268130816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790961.476147:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268130944:12345-0@lo:400:kworker.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.476153:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790961.476186:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4596d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268130816:12345-0@lo:400:kworker.0 Request processed in 53us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790961.476191:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268130816:0@lo:400:kworker.0 00000100:00100000:3.0:1787790961.476197:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787790961.476208:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbebe1c0 x1874634268130688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790961.476219:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268130688:0@lo:400:kworker.0 00010000:00080000:0.0:1787790961.476251:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbebd2c0 x1874634268130944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790961.476260:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268130944:0@lo:400:kworker.0 00000020:01000004:1.0:1787790961.478702:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787790961.478830:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9170d63819b8) 00000020:00000080:1.0:1787790961.478852:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787790961.478929:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f67ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787790961.478933:0:18662:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f67ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787790961.478936:0:18662:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67ce800 3 00010000:00080000:1.0:1787790961.478965:0:18662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170e02d6800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790961.481638:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787790961.482050:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787790961.482097:0:18662:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787790961.482108:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf9477fddcf1ed98 00000100:00080000:1.0:1787790961.482131:0:18662:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790961.482137:0:18662:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9170e02d6800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790961.482174:0:18662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebd2c0 x1874634268131072/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790961.482208:0:18662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787790961.482232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.482236:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790961.482240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.482243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790961.482247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.482250:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790961.482252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790961.482256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787790961.483244:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:0.0:1787790961.484907:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268131072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790961.484982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790961.487271:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131072 00000100:00100000:1.0:1787790961.487284:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131072 00000020:01000000:0.0:1787790961.487297:0:18636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:1.0:1787790961.487329:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1787790961.487337:0:18636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1787790961.487339:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874634268131072:12345-0@lo:38:llog_process_th.0 00010000:00010000:0.0:1787790961.487355:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790961.487368:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787790961.487370:0:18527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:01000004:0.0:1787790961.487420:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787790961.487422:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787790961.487423:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790961.487425:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790961.487426:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790961.487428:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790961.487430:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790961.487431:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790961.487432:0:18636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790961.487436:0:18636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787790961.487438:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787790961.487440:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787790961.487441:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790961.487442:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790961.487443:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787790961.487444:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790961.487445:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790961.487446:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790961.487447:0:18636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787790961.487466:0:18636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787790961.487481:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268131200:0@lo:253:mount.lustre.0 00000020:00000080:1.0:1787790961.487513:0:18527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf9477fddcf1ed9f 00000004:00100000:1.0:1787790961.487531:0:18527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787790961.487543:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787790961.487564:0:18527:0:(import.c:65:import_set_state_nolock()) ffff916fc393b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787790961.487585:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790961.487622:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874634268131072:12345-0@lo:38:llog_process_th.0 Request processed in 282us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.487630:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787790961.487639:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170fbebd2c0 x1874634268131072/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790961.487651:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790961.487659:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787790961.487665:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787790961.487669:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787790961.487671:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170e02d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787790961.487677:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268131072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787790961.487689:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131200 00000100:00100000:3.0:1787790961.487694:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131200 00000100:00100000:3.0:1787790961.487819:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790961.487828:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268131200:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787790961.487848:0:17128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787790961.487865:0:17128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787790961.497376:0:17128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787790961.497459:0:17128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787790961.497559:0:17150:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787790961.497565:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787790961.497593:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.497612:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 21 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.497622:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 21 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.497640:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.497681:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 21 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.497698:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 21 pid: 17128 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.497814:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268131328:0@lo:104: 00000100:00100000:3.0:1787790961.497896:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790961.497941:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 21 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.497950:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 21 pid: 17127 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.497958:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268131456:0@lo:104: 00000100:00100000:3.0:1787790961.497981:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790961.497996:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790961.498490:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:18636:x1874634268131200:12345-0@lo:253:mount.lustre.0 Request processed in 10562us (10846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790961.498502:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787790961.498567:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:18636:1874634268131200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787790961.498578:0:18636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787790961.498581:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787790961.498583:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787790961.498584:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790961.498591:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790961.498592:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790961.498593:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790961.498595:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790961.498596:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790961.498598:0:18636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787790961.498611:0:18636:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787790961.498865:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787790961.498884:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131328 00000100:00100000:2.0:1787790961.498888:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131328 00000100:00100000:2.0:1787790961.498915:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131456 00000100:00100000:2.0:1787790961.498919:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131456 00000100:00100000:2.0:1787790961.498937:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790961.498947:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:17150:x1874634268131328:12345-0@lo:104: 00010000:00010000:2.0:1787790961.498961:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499016:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790961.499023:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:17150:x1874634268131328:12345-0@lo:104: Request processed in 78us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790961.499030:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790961.499054:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787790961.499063:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc46f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268131456:12345-0@lo:104: 00010000:00010000:2.0:1787790961.499070:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.499232:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268131328:0@lo:104: 00010000:00010000:2.0:1787790961.499483:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787790961.499490:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc46f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268131456:12345-0@lo:104: Request processed in 429us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790961.499496:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787790961.499530:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790961.499536:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499549:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790961.499554:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499563:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790961.499571:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790961.499573:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5aed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268131456:0@lo:104: 10000000:01000000:2.0:1787790961.499583:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787790961.499595:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499616:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499623:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790961.499654:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499663:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fbe00/0xcf9477fddcf1ecf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499675:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790961.499679:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499685:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790961.499688:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499722:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790961.499728:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790961.499733:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787790961.499746:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499752:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787790961.499774:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499781:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5000/0xcf9477fddcf1ece9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ecf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790961.499794:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790961.499797:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790961.499799:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790961.499806:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790961.499822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790961.499823:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268131712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790961.499833:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268131584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790961.500284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790961.500340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790961.500383:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131712 00000100:00100000:1.0:1787790961.500637:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131712 00010000:00010000:1.0:1787790961.500663:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 21 pid: 17127 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790961.500697:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131584 00000100:00100000:1.0:1787790961.500700:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131584 00010000:00010000:1.0:1787790961.500839:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 22 pid: 17128 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790961.500860:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790961.500869:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:3638:x1874634268131712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790961.500883:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790961.500888:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 22 pid: 17127 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.500898:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 22 pid: 17127 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.500913:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fbc00/0xcf9477fddcf1ecf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ece9 expref: 22 pid: 17127 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.500925:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790961.500962:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3638:x1874634268131712:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.500969:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790961.500984:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790961.500990:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37af850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:3640:x1874634268131584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790961.500996:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790961.501000:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 20 pid: 17128 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501016:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 20 pid: 17128 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501027:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1ecfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ecf7 expref: 20 pid: 17128 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501038:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501046:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787790961.501059:0:17120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005348064s 00010000:00010000:1.0:1787790961.501064:0:17120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501073:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501080:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501086:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501103:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790961.501107:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501124:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501144:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790961.501155:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790961.501184:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37af850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:3640:x1874634268131584:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790961.501191:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790961.501261:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268131712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787790961.501630:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268131584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790961.502057:0:17150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.502068:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790961.502075:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539a00/0xcf9477fddcf1eda6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787790961.503657:0:18636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787790961.527355:0:18636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787790961.527448:0:18636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787790961.527489:0:18636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787790961.527535:0:18636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787790961.527552:0:18636:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787790961.527577:0:18636:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787790961.528619:0:18636:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790961.528847:0:18636:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787790961.932131:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787790962.500143:0:18716:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790962.500352:0:18716:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787790962.890998:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790962.891007:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce839000 from 9 10000000:01000000:0.0:1787790962.891013:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790962.891056:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.891068:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.891080:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790962.891117:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268131840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790962.891198:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790962.891241:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790962.891475:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131840 00000100:00100000:1.0:1787790962.891483:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131840 00000100:00100000:1.0:1787790962.891577:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787790962.891587:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:17131:x1874634268131840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790962.891599:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790962.891612:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1edad expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790962.891635:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 20 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790962.891646:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 20 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790962.891656:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:1.0:1787790962.891700:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:17131:x1874634268131840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790962.892054:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787790962.892146:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268131840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790962.892162:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790962.892172:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790962.892225:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268131968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787790962.892260:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790962.899439:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787790962.906599:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268131968 00000100:00100000:0.0:1787790962.906615:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268131968 00000100:00100000:0.0:1787790962.906692:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787790962.906702:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:17131:x1874634268131968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787790962.906744:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790962.906758:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790962.906761:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787790962.906896:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:17131:x1874634268131968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (14634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790962.906904:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787790962.906973:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268131968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787790962.907059:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790962.907071:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907083:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790962.907156:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790962.907159:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff916fc46e5000 from 9 10000000:01000000:0.0:1787790962.907162:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790962.907195:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907204:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907222:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790962.907243:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268132096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790962.907276:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790962.907303:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790962.907314:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132096 00000100:00100000:0.0:1787790962.907317:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132096 00000100:00100000:0.0:1787790962.907333:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787790962.907338:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:17131:x1874634268132096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790962.907346:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790962.907357:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1edbb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907376:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 21 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907386:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 21 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907395:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4400, rc 0) 00000100:00100000:0.0:1787790962.907417:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268132096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790962.907424:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787790962.907442:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268132096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790962.907452:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907466:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790962.907499:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268132224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787790962.907523:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790962.907530:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790962.907543:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132224 00000100:00100000:0.0:1787790962.907545:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132224 00000100:00100000:0.0:1787790962.907559:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787790962.907564:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268132224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787790962.907572:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790962.907582:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790962.907584:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787790962.907642:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268132224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790962.907649:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787790962.907665:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268132224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787790962.907696:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790962.907701:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790962.907728:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790962.955162:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790963.018991:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790963.019014:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268132352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790963.019093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790963.019462:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132352 00000100:00100000:1.0:1787790963.019481:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132352 00000100:00100000:1.0:1787790963.019527:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790963.019536:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268132352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790963.019567:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787790963.019620:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268132352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790963.019627:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790963.020725:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790963.021305:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268132480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790963.021355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790963.021443:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132480 00000100:00100000:1.0:1787790963.021450:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132480 00000100:00100000:1.0:1787790963.021491:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790963.021499:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268132480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790963.021524:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787790963.021560:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268132480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790963.021567:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787790963.021841:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268132480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790963.022280:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268132352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787790963.978838:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790965.004942:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787790965.451540:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790966.027069:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787790966.605435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790966.605443:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790966.605445:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790966.605448:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790966.605464:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790966.605468:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787790966.605470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787790966.605473:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787790966.605515:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268132608:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.605677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.605756:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc44621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268133120:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.605789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.605816:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790966.605823:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268132992:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.605849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.605880:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268132736:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.605904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.605923:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268133248:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.605947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.605963:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787790966.605968:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268132864:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.605987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.606001:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268133376:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790966.606174:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132608 00000100:00100000:2.0:1787790966.606181:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132608 00000100:00100000:2.0:1787790966.606225:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787790966.606233:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3641:x1874634268132608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606387:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3641:x1874634268132608:12345-0@lo:400:kworker.0 Request processed in 154us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606394:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787790966.606429:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133120 00000100:00100000:2.0:1787790966.606433:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133120 00000100:00100000:2.0:1787790966.606448:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133248 00000100:00100000:2.0:1787790966.606450:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133248 00000100:00100000:2.0:1787790966.606479:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132864 00000100:00100000:2.0:1787790966.606482:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132864 00000100:00100000:2.0:1787790966.606502:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133376 00000100:00100000:2.0:1787790966.606505:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133376 00000100:00100000:2.0:1787790966.606520:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790966.606525:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268133120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606575:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268133120:12345-0@lo:400:kworker.0 Request processed in 49us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606580:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790966.606591:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790966.606596:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606625:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268133248:12345-0@lo:400:kworker.0 Request processed in 28us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606631:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790966.606641:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790966.606647:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606671:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268132864:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606677:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787790966.606686:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790966.606692:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268133376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606737:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268133376:12345-0@lo:400:kworker.0 Request processed in 45us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606742:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790966.606760:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132992 00000100:00100000:2.0:1787790966.606764:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132992 00000100:00100000:2.0:1787790966.606787:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268132736 00000100:00100000:2.0:1787790966.606790:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268132736 00000100:00100000:2.0:1787790966.606801:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790966.606813:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268132992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606846:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268132992:12345-0@lo:400:kworker.0 Request processed in 33us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606852:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787790966.606865:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787790966.606871:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268132736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.606913:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268132736:12345-0@lo:400:kworker.0 Request processed in 42us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790966.606919:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787790966.606974:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc4460780 x1874634268132864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790966.606988:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268132864:0@lo:400:kworker.0 00010000:00080000:2.0:1787790966.607000:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc4462580 x1874634268133376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790966.607020:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268133376:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.607032:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268132736:0@lo:400:kworker.0 00010000:00080000:2.0:1787790966.607041:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc4460b40 x1874634268133248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790966.607049:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268133248:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.607091:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268132992:0@lo:400:kworker.0 00000100:00100000:2.0:1787790966.607099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268132608:0@lo:400:kworker.0 00010000:00080000:2.0:1787790966.607108:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc44621c0 x1874634268133120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790966.607121:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc44621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268133120:0@lo:400:kworker.0 00000100:00080000:2.0:1787790966.607178:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790966.607182:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787790967.050873:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787790967.594875:0:19006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787790968.075253:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790968.138947:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790968.138971:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268133504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790968.139045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790968.139238:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790968.139251:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268133632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790968.143094:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133504 00000100:00100000:3.0:1787790968.143112:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133504 00000100:00100000:3.0:1787790968.143170:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787790968.143205:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268133504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790968.143284:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790968.143376:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268133504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790968.143384:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787790968.143442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790968.143474:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133632 00000100:00100000:2.0:1787790968.143477:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133632 00000100:00100000:2.0:1787790968.143496:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790968.143501:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268133632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790968.143518:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790968.143547:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268133632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790968.143552:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787790968.143592:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268133632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790968.143641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268133504:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1787790968.458483:0:19058:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790968.458686:0:19058:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787790969.037415:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790969.100928:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787790969.175414:0:19108:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790969.175654:0:19108:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787790970.124145:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790971.150128:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787790971.722931:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790971.722938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790971.722940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790971.722943:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790971.722967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790971.722970:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787790971.722972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790971.722976:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787790971.723104:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268133888:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723241:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268134400:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723300:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787790971.723323:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268133760:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723374:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268134272:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723420:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268134016:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723460:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268134528:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723493:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787790971.723498:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268134144:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790971.723548:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134400 00000100:00100000:2.0:1787790971.723555:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134400 00000100:00100000:2.0:1787790971.723600:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134272 00000100:00100000:2.0:1787790971.723603:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134272 00000100:00100000:2.0:1787790971.723616:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134016 00000100:00100000:2.0:1787790971.723618:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134016 00000100:00100000:2.0:1787790971.723627:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134528 00000100:00100000:2.0:1787790971.723629:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134528 00000100:00100000:2.0:1787790971.723645:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790971.723653:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268134400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723729:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268134400:12345-0@lo:400:kworker.0 Request processed in 49us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.723738:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787790971.723757:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790971.723763:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268134272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723790:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268134272:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.723803:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790971.723815:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787790971.723820:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268134016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723852:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268134016:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.723858:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787790971.723870:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787790971.723876:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268134528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.723902:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268134528:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.723907:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787790971.723925:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133760 00000100:00100000:2.0:1787790971.723928:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133760 00000100:00100000:2.0:1787790971.723967:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787790971.723973:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3639:x1874634268133760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.724003:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3639:x1874634268133760:12345-0@lo:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.724008:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787790971.724052:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268133888 00000100:00100000:2.0:1787790971.724055:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268133888 00000100:00100000:2.0:1787790971.724077:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134144 00000100:00100000:2.0:1787790971.724079:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134144 00000100:00100000:2.0:1787790971.724090:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790971.724095:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268133888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.724126:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268133888:12345-0@lo:400:kworker.0 Request processed in 31us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.724140:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787790971.724152:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787790971.724157:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268134144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.724184:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268134144:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790971.724189:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787790971.724203:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787790971.724207:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790971.724240:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268134144:0@lo:400:kworker.0 00010000:00080000:2.0:1787790971.724254:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc4588b40 x1874634268134016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790971.724264:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268134016:0@lo:400:kworker.0 00010000:00080000:2.0:1787790971.724274:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc458a580 x1874634268134528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790971.724282:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268134528:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.724309:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268133760:0@lo:400:kworker.0 00010000:00080000:2.0:1787790971.724318:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc45883c0 x1874634268134272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790971.724326:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268134272:0@lo:400:kworker.0 00000100:00100000:2.0:1787790971.724335:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268133888:0@lo:400:kworker.0 00010000:00080000:2.0:1787790971.724343:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc458b0c0 x1874634268134400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790971.724363:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268134400:0@lo:400:kworker.0 00010000:00010000:1.0:1787790972.170989:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790972.749101:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790957/real 1787790957] req@ffff9170fbebc780 x1874634268126848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790972.749136:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170fbebc780 x1874634268126848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790972.749147:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790957/real 1787790957] req@ffff9170fbebe940 x1874634268126976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790972.749159:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170fbebe940 x1874634268126976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787790972.749181:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790972.749202:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787790972.749207:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268126848:0@lo:8:kworker.0 00000100:00080000:3.0:1787790972.749212:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790972.749217:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787790972.749219:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268126976:0@lo:8:kworker.0 00000100:00080000:3.0:1787790972.749316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790972.749320:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787790972.749323:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790972.749326:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787790972.749361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790972.749364:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787790972.749367:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790972.749372:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:3.0:1787790972.749377:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787790972.749385:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170d614d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790972.749406:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ae1c0 x1874634268135168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787790972.749418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787790972.749421:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787790972.749422:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787790972.749425:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:3.0:1787790972.749428:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787790972.749430:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170d6153000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787790972.749440:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5afc00 x1874634268135296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787790972.749480:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268134784:0@lo:400:kworker.0 00000100:00100000:3.0:1787790972.749541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790972.749568:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268135552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790972.749595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790972.749613:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787790972.749619:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268134912:0@lo:400:kworker.0 00000100:00100000:3.0:1787790972.749639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790972.749655:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268135680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790972.749689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790972.749732:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268135168:0@lo:8:kworker.0 00000100:00100000:3.0:1787790972.749758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790972.749781:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268135296:0@lo:8:kworker.0 00000100:00100000:3.0:1787790972.749805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790972.749840:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135168 00000100:00100000:3.0:1787790972.749846:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135168 00000100:00100000:3.0:1787790972.749870:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135296 00000100:00100000:3.0:1787790972.749872:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135296 00000100:00100000:3.0:1787790972.749885:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790972.749892:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874634268135168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787790972.749921:0:18642:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1787790972.749947:0:18642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1edc9 00002000:00100000:3.0:1787790972.749960:0:18642:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9170e02d6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787790972.749965:0:18642:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787790972.749968:0:18642:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787790972.750153:0:18642:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787790972.750175:0:18642:0:(import.c:65:import_set_state_nolock()) ffff9170e02d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790972.750222:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634268135168:12345-0@lo:8:kworker.0 Request processed in 329us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790972.750230:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787790972.750246:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787790972.750250:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874634268135296:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787790972.750262:0:18642:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787790972.755801:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135552 00000100:00100000:0.0:1787790972.755816:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135552 00000100:00100000:0.0:1787790972.755869:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134912 00000100:00100000:0.0:1787790972.755871:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134912 00000100:00100000:0.0:1787790972.755881:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135680 00000100:00100000:0.0:1787790972.755883:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135680 00000100:00100000:0.0:1787790972.755901:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790972.755919:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268135552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790972.756385:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268135552:12345-0@lo:400:kworker.0 Request processed in 412us (6725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.756395:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790972.756416:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790972.756424:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268134912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790972.756456:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268134912:12345-0@lo:400:kworker.0 Request processed in 34us (6816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.756477:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790972.756490:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790972.756497:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268135680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790972.756526:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268135680:12345-0@lo:400:kworker.0 Request processed in 30us (6836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.756531:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787790972.757818:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268134656:0@lo:400:kworker.0 00000100:00100000:2.0:1787790972.757883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790972.758813:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268135424:0@lo:400:kworker.0 00000100:00100000:2.0:1787790972.758855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790972.758892:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787790972.758899:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268135040:0@lo:400:kworker.0 00000100:00100000:0.0:1787790972.759116:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134784 00000100:00100000:0.0:1787790972.759124:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134784 00000100:00100000:0.0:1787790972.759506:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787790972.759517:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790972.760385:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268134784:12345-0@lo:400:kworker.0 Request processed in 807us (10780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.760394:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787790972.760454:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790972.760649:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135040 00000100:00100000:1.0:1787790972.760773:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135424 00000100:00100000:1.0:1787790972.760780:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135424 00000100:00100000:1.0:1787790972.760817:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790972.760825:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268135424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790972.760889:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268135424:12345-0@lo:400:kworker.0 Request processed in 64us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790972.760896:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787790972.760929:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268134656 00000100:00100000:1.0:1787790972.760932:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268134656 00000100:00100000:1.0:1787790972.761092:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787790972.761099:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3641:x1874634268134656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790972.761133:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3641:x1874634268134656:12345-0@lo:400:kworker.0 Request processed in 34us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790972.761139:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787790972.761879:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135040 00000100:00100000:0.0:1787790972.761929:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787790972.762463:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790972.762517:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268135040:12345-0@lo:400:kworker.0 Request processed in 61us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.762524:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787790972.764178:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268135040:0@lo:400:kworker.0 00000100:00100000:2.0:1787790972.764206:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268134656:0@lo:400:kworker.0 00010000:00080000:2.0:1787790972.764221:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5ad2c0 x1874634268135424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790972.764231:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268135424:0@lo:400:kworker.0 00010000:00080000:2.0:1787790972.771852:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5ae1c0 x1874634268135168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787790992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790972.771867:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790972.771878:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787790972.771887:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787790972.771893:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787790972.771897:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787790972.772722:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787790972.772732:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268135168:0@lo:8:kworker.0 00000004:00080000:0.0:1787790972.775206:0:17875:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787790972.775309:0:17875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 521723602994ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787790972.775320:0:17875:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787790972.783131:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268135808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790972.783341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790972.783414:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135808 00000100:00100000:1.0:1787790972.783421:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135808 00000100:00100000:1.0:1787790972.783477:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790972.783486:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268135808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787790972.783514:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787790972.783560:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268135808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790972.783568:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787790972.783589:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787790972.783616:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634268135808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790972.783633:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268135808:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787790972.783669:0:17876:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787790972.783731:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17876:1874634268135936:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787790972.783759:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790972.783785:0:18640:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787790972.783792:0:18640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787790972.783880:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771600 going to sleep for 11 seconds 00010000:00080000:3.0:1787790972.787627:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5ada40 x1874634268134912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790972.788147:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268134912:0@lo:400:kworker.0 00010000:00080000:3.0:1787790972.788167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5ade00 x1874634268135680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790972.788176:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268135680:0@lo:400:kworker.0 00000100:00100000:3.0:1787790972.788189:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268134784:0@lo:400:kworker.0 00010000:00080000:3.0:1787790972.788201:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5ac000 x1874634268135552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790972.788209:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268135552:0@lo:400:kworker.0 00000100:00100000:3.0:1787790972.789865:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874634268135296:12345-0@lo:8:kworker.0 Request processed in 39607us (40054us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787790972.789879:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787790972.789943:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787790972.789948:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787790972.789953:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268135296:0@lo:8:kworker.0 00000100:00100000:3.0:1787790972.789979:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268135936 00000100:00100000:3.0:1787790972.789985:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268135936 00000100:00100000:3.0:1787790972.790492:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787790972.790502:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17876:x1874634268135936:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787790972.795570:0:17867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787790972.805886:0:18643:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787790972.805894:0:18643:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787790972.805989:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17876:x1874634268135936:12345-0@lo:7:osp-pre-0-1.0 Request processed in 15483us (22224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.806021:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787790972.810237:0:17876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634268135936/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790988 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790972.810256:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17876:1874634268135936:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787790972.810270:0:17876:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787790972.810311:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17876:1874634268136064:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787790972.810367:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790972.810401:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790972.810843:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136064 00000100:00100000:0.0:1787790972.810850:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136064 00000100:00100000:0.0:1787790972.810912:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787790972.810923:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17876:x1874634268136064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787790972.810950:0:18642:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787790972.811001:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17876:x1874634268136064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.811008:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787790972.811091:0:17876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634268136064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790988 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790972.811102:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17876:1874634268136064:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787790972.811112:0:17876:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787790972.811136:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17876:1874634268136192:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787790972.811171:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790972.811199:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790972.811783:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136192 00000100:00100000:0.0:1787790972.811789:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136192 00000100:00100000:0.0:1787790972.811827:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787790972.811836:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17876:x1874634268136192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787790972.811870:0:19281:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1787790972.852425:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787790972.852445:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787790972.854596:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17876:x1874634268136192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42750us (43413us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787790972.854610:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787790972.854699:0:17876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634268136192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790988 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790972.854739:0:17876:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787790972.854746:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17876:1874634268136192:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787790972.854763:0:17876:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787790972.854825:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17876:1874634268136320:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787790972.854862:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790972.854894:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3771600 going to sleep for 11 seconds 00000100:00100000:0.0:1787790972.855048:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136320 00000100:00100000:0.0:1787790972.855055:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136320 00000100:00100000:0.0:1787790972.855104:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790972.855113:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17876:x1874634268136320:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787790972.855176:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17876:x1874634268136320:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790972.855184:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787790972.855498:0:17876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634268136320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787790988 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790972.855509:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17876:1874634268136320:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787790973.195303:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790973.265365:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268136448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790973.265452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790973.266278:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136448 00000100:00100000:3.0:1787790973.266288:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136448 00000100:00100000:3.0:1787790973.266348:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790973.266358:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268136448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790973.266393:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790973.266451:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268136448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790973.266458:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787790973.266508:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268136448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790973.269161:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790973.269186:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268136576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790973.269248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790973.269400:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136576 00000100:00100000:1.0:1787790973.269407:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136576 00000100:00100000:1.0:1787790973.269456:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787790973.269466:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268136576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790973.269495:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787790973.269542:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268136576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790973.269548:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787790973.269589:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268136576:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787790974.222094:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790975.243431:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790975.691622:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787790976.266925:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787790976.288232:0:19454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787790976.288237:0:19454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787790976.288238:0:19454:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787790976.288347:0:19454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170e02d7800 00000020:01000004:3.0:1787790976.288362:0:19454:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787790976.288375:0:19454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787790976.288388:0:19454:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9170eef519b8) 00000020:00000080:3.0:1787790976.288407:0:19454:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787790976.424952:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787790976.431770:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787790976.432547:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787790976.432754:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787790976.433289:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787790976.433599:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787790976.433861:0:19454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787790976.438631:0:19454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787790976.438900:0:19454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787790976.438914:0:19454:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787790976.438927:0:19454:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf9477fddcf1edd7 00000020:01000004:2.0:1787790976.438933:0:19454:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787790976.438955:0:19454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787790976.438959:0:19454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787790976.438965:0:19454:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787790976.439006:0:19454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787790976.439011:0:19454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787790976.450888:0:19454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787790976.450928:0:19454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787790976.450933:0:19454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787790976.450935:0:19454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790976.450936:0:19454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790976.450937:0:19454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790976.450938:0:19454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790976.450939:0:19454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790976.450941:0:19454:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790976.450943:0:19454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790976.450944:0:19454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790976.450947:0:19454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787790976.450949:0:19454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787790976.450951:0:19454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790976.450952:0:19454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790976.450953:0:19454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790976.450954:0:19454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790976.450955:0:19454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790976.450960:0:19454:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790976.450961:0:19454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790976.450962:0:19454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787790976.451003:0:19454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787790976.451024:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268136704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787790976.451101:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.451161:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.451258:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136704 00000100:00100000:2.0:1787790976.451266:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136704 00000100:00100000:2.0:1787790976.451314:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787790976.451323:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:19454:x1874634268136704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787790976.451353:0:17129:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787790976.451356:0:17129:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787790976.451360:0:17129:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787790976.451679:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:19454:x1874634268136704:12345-0@lo:253:mount.lustre.0 Request processed in 357us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.451697:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787790976.451735:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268136704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787790976.451745:0:19454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787790976.451748:0:19454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787790976.451749:0:19454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787790976.451750:0:19454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787790976.451751:0:19454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787790976.451752:0:19454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787790976.451753:0:19454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787790976.451754:0:19454:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787790976.451755:0:19454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787790976.451756:0:19454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787790976.451776:0:19454:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170e02d7800 from lustre-OST0001 10000000:01000000:3.0:1787790976.451800:0:19454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787790976.451803:0:19454:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787790976.451812:0:19454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9170fc134d28 local copy 00010000:00010000:3.0:1787790976.451824:0:19454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790976.451910:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268136832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790976.451942:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.451967:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81180 going to sleep for 11 seconds 00000100:00100000:1.0:1787790976.452010:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136832 00000100:00100000:1.0:1787790976.452016:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136832 00000100:00100000:1.0:1787790976.452051:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787790976.452057:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:19454:x1874634268136832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790976.452136:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:19454:x1874634268136832:12345-0@lo:501:mount.lustre.0 Request processed in 79us (193us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790976.452145:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787790976.452161:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268136832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787790976.452185:0:19454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787790976.452204:0:19454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787790976.452215:0:19454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.452224:0:19454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790976.452249:0:19454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170e02d7800 10000000:01000000:3.0:1787790976.452255:0:19454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787790976.452260:0:19454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787790976.452263:0:19454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787790976.452267:0:19454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787790976.452270:0:19454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787790976.452293:0:19454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.452301:0:19454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.452310:0:19454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790976.452324:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268136960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787790976.452349:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.452368:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.452407:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268136960 00000100:00100000:2.0:1787790976.452412:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268136960 00000100:00100000:2.0:1787790976.452435:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787790976.452440:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:19454:x1874634268136960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790976.452449:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790976.452461:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1ede5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1edde expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.452481:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1ede5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1edde expref: 22 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.452490:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1ede5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edde expref: 22 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.452498:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995400, rc 0) 00000100:00100000:2.0:1787790976.452526:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268136960:12345-0@lo:101:mount.lustre.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.452531:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787790976.452538:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268136960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790976.452549:0:19454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.452558:0:19454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790976.453818:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787790976.454508:0:19454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790976.456762:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787790976.456803:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787790976.456812:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787790976.456821:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787790976.456828:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787790976.456835:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787790976.456849:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787790976.456852:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787790976.456951:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790976.457022:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.457065:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81900 going to sleep for 11 seconds 00000100:00100000:1.0:1787790976.457080:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137088 00000100:00100000:1.0:1787790976.457089:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137088 00000100:00100000:1.0:1787790976.457153:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787790976.457163:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790976.457404:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137088:12345-0@lo:501:mount.lustre.0 Request processed in 242us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.457415:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787790976.457425:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790976.457453:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790976.457480:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.457524:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81900 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.457548:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137216 00000100:00100000:2.0:1787790976.457551:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137216 00000100:00100000:2.0:1787790976.457574:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787790976.457578:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790976.458344:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137216:12345-0@lo:503:mount.lustre.0 Request processed in 762us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790976.458350:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787790976.458375:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137216:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787790976.458815:0:19454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790976.458877:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790976.458911:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.458940:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352840 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.458953:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137344 00000100:00100000:2.0:1787790976.458959:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137344 00000100:00100000:2.0:1787790976.458999:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787790976.459007:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790976.459410:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137344:12345-0@lo:502:mount.lustre.0 Request processed in 405us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.459416:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787790976.459442:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790976.459630:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787790976.459655:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787790976.459667:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787790976.459674:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787790976.459687:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787790976.459699:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787790976.459743:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787790976.459753:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787790976.459760:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787790976.459777:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790976.459811:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.459831:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137472 00000100:00100000:3.0:1787790976.459835:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137472 00000100:00100000:1.0:1787790976.459837:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352840 going to sleep for 11 seconds 00000100:00100000:3.0:1787790976.459860:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787790976.459869:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790976.459925:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137472:12345-0@lo:502:mount.lustre.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790976.459936:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787790976.459954:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790976.460000:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787790976.460008:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787790976.460437:0:19458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787790976.460445:0:19458:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787790976.460458:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790976.460461:0:19458:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787790976.460526:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787790976.460541:0:19458:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9170d6380000) 00000020:00000080:1.0:1787790976.460562:0:19458:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787790976.460567:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787790976.460648:0:19458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170e02d7800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787790976.460658:0:19458:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787790976.460663:0:19458:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf9477fddcf1edf3 00010000:00010000:1.0:1787790976.464122:0:19458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787790976.464594:0:19458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787790976.466764:0:19458:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787790976.467940:0:19458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787790976.467951:0:19458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790976.467957:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790976.467960:0:19458:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787790976.467964:0:19458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790976.467969:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790976.467970:0:19458:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787790976.467974:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787790976.467976:0:19458:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787790976.467994:0:19458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790976.467998:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790976.467999:0:19458:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787790976.468002:0:19458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787790976.468005:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790976.468020:0:19458:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787790976.468025:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787790976.468056:0:19458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787790976.468059:0:19458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787790976.468061:0:19458:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787790976.468064:0:19458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787790976.472282:0:19454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787790976.472350:0:19454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787790976.472378:0:19454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.472392:0:19454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790976.472401:0:19454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170e02d7800 from 1 10000000:01000000:3.0:1787790976.472404:0:19454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790976.472445:0:19454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.472453:0:19454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.472464:0:19454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790976.472489:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787790976.472556:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.472596:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81780 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.472660:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137600 00000100:00100000:2.0:1787790976.472667:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137600 00000100:00100000:2.0:1787790976.472741:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787790976.472751:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:19454:x1874634268137600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787790976.472764:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790976.472777:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1edfa expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.472801:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.472812:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.472821:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995200, rc 0) 00000100:00100000:2.0:1787790976.472860:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137600:12345-0@lo:101:mount.lustre.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.472866:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787790976.472968:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787790976.473107:0:19454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790976.473117:0:19454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787790976.479106:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787790976.479399:0:19454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787790976.479564:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787790976.479584:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787790976.479599:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787790976.479604:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787790976.479673:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787790976.479778:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790976.479812:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.479924:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137728 00000100:00100000:2.0:1787790976.479931:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137728 00000100:00100000:2.0:1787790976.479989:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787790976.479998:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787790976.480110:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137728:12345-0@lo:501:mount.lustre.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.480211:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787790976.480541:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790976.480576:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787790976.480613:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790976.480641:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c7d0ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787790976.480733:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137856 00000100:00100000:3.0:1787790976.480738:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137856 00000100:00100000:3.0:1787790976.480844:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787790976.480853:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787790976.480941:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137856:12345-0@lo:503:mount.lustre.0 Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790976.480947:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787790976.481023:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787790976.481360:0:19454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790976.481413:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790976.481446:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.481775:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d11899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.481838:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268137984 00000100:00100000:2.0:1787790976.481843:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268137984 00000100:00100000:2.0:1787790976.481865:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787790976.481872:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790976.481996:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268137984:12345-0@lo:502:mount.lustre.0 Request processed in 124us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.482003:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787790976.482242:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268137984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790976.482395:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787790976.482417:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787790976.482426:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787790976.482433:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787790976.482440:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787790976.482448:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787790976.482455:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787790976.482462:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787790976.482469:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787790976.482477:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787790976.482483:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787790976.482500:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790976.482525:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.482571:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787790976.482594:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138112 00000100:00100000:2.0:1787790976.482597:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138112 00000100:00100000:2.0:1787790976.482619:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787790976.482625:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268138112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790976.482733:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268138112:12345-0@lo:502:mount.lustre.0 Request processed in 107us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.482739:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787790976.482873:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787790976.482898:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787790976.482903:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787790976.483504:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790976.483514:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483516:0:19462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787790976.483522:0:19462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170e02d7800 00000020:00000080:3.0:1787790976.483525:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790976.483532:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790976.483535:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483536:0:19462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787790976.483539:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790976.483541:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483542:0:19462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787790976.483545:0:19462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170e02d7800 00000020:00000080:3.0:1787790976.483556:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790976.483621:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790976.483625:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483626:0:19462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787790976.483629:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790976.483632:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483633:0:19462:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790976.483636:0:19462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170e02d7800 00000020:00000080:3.0:1787790976.483638:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790976.483656:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790976.483659:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483660:0:19462:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787790976.483663:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787790976.483666:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483667:0:19462:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787790976.483670:0:19462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170e02d7800 00000020:00000080:3.0:1787790976.483672:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787790976.483694:0:19462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787790976.483696:0:19462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787790976.483698:0:19462:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787790976.483701:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787790976.485211:0:19454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787790976.485242:0:19454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787790976.485256:0:19454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485265:0:19454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790976.485317:0:19454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787790976.485319:0:19454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170e02d7800 10000000:01000000:1.0:1787790976.485322:0:19454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170e02d7800 10000000:01000000:1.0:1787790976.485325:0:19454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787790976.485331:0:19454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170e02d7800 from 1 10000000:01000000:1.0:1787790976.485333:0:19454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787790976.485365:0:19454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485372:0:19454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485382:0:19454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790976.485401:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787790976.485447:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.485476:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138240 00000100:00100000:1.0:1787790976.485481:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138240 00000100:00100000:1.0:1787790976.485508:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787790976.485514:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:19454:x1874634268138240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790976.485524:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790976.485536:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ee0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ee08 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485559:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ee0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ee08 expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485580:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ee0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ee08 expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485588:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb400, rc 0) 00000100:00100000:1.0:1787790976.485617:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138240:12345-0@lo:101:mount.lustre.0 Request processed in 102us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.485624:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787790976.485659:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790976.485677:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787790976.485689:0:19454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.485695:0:19454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790976.488280:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1787790976.488568:0:19454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787790976.488822:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787790976.488853:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787790976.488871:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787790976.488889:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787790976.488907:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787790976.488923:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787790976.488938:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787790976.488955:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787790976.488970:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787790976.489000:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787790976.489020:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787790976.489319:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787790976.489341:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787790976.489355:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787790976.489370:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787790976.489385:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787790976.489413:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787790976.489428:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787790976.489443:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787790976.489457:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787790976.489473:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787790976.489487:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787790976.489502:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787790976.489516:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787790976.489531:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787790976.489546:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787790976.489561:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787790976.489575:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787790976.489588:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787790976.489603:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787790976.489619:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787790976.489633:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787790976.489662:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787790976.489679:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787790976.489693:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787790976.489708:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787790976.489742:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787790976.489759:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787790976.489774:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1787790976.489787:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1787790976.489802:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1787790976.489817:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1787790976.489832:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1787790976.489849:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1787790976.489876:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1787790976.489891:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1787790976.489916:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1787790976.489922:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1787790976.490038:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790976.492053:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790976.492175:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138368 00000100:00100000:0.0:1787790976.492184:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138368 00000100:00100000:1.0:1787790976.492186:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352840 going to sleep for 11 seconds 00000100:00100000:0.0:1787790976.492247:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787790976.492259:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787790976.492410:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138368:12345-0@lo:501:mount.lustre.0 Request processed in 153us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790976.492419:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787790976.492505:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787790976.492552:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790976.492599:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.492622:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138496 00000100:00100000:1.0:1787790976.492626:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138496 00000100:00100000:1.0:1787790976.492658:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787790976.492667:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787790976.492844:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138496:12345-0@lo:503:mount.lustre.0 Request processed in 179us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.492852:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787790976.492886:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790976.492899:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138496:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787790976.494163:0:19454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787790976.494251:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790976.494302:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.494341:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e1097780 going to sleep for 11 seconds 00000100:00100000:0.0:1787790976.494827:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138624 00000100:00100000:0.0:1787790976.494834:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138624 00000100:00100000:0.0:1787790976.494872:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787790976.494881:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787790976.495000:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138624:12345-0@lo:502:mount.lustre.0 Request processed in 120us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790976.495009:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787790976.495026:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790976.495283:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787790976.495322:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787790976.495346:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787790976.495369:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787790976.495404:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787790976.495431:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787790976.495457:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787790976.495491:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787790976.495511:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787790976.495529:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787790976.495548:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787790976.495579:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787790976.495599:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787790976.495617:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787790976.495634:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787790976.495651:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787790976.495663:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787790976.495672:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787790976.495687:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787790976.496024:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787790976.496060:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787790976.496080:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787790976.496095:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787790976.496109:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787790976.496123:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787790976.496137:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787790976.496150:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787790976.496164:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787790976.496178:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787790976.496195:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787790976.496213:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787790976.496236:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787790976.496312:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787790976.496335:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787790976.496353:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787790976.496371:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787790976.496402:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787790976.496422:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787790976.496438:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787790976.496455:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787790976.496634:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787790976.496656:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787790976.496675:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787790976.496694:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787790976.496743:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787790976.496761:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787790976.496848:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787790976.496871:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787790976.496997:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790976.497062:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.497105:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787790976.497111:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138752 00000100:00100000:3.0:1787790976.497119:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138752 00000100:00100000:3.0:1787790976.497239:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787790976.497250:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787790976.497355:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138752:12345-0@lo:502:mount.lustre.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790976.497362:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787790976.497400:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790976.497568:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787790976.497596:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787790976.497621:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787790976.497663:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.497821:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787790976.497871:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268138880 00000100:00100000:1.0:1787790976.497876:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268138880 00000100:00100000:1.0:1787790976.497906:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787790976.497914:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787790976.498012:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268138880:12345-0@lo:502:mount.lustre.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.498020:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787790976.498048:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268138880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787790976.498088:0:19454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787790976.498096:0:19454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787790976.498900:0:19467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787790976.498915:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9170d6384d28) 00000020:00000080:1.0:1787790976.498938:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787790976.499036:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170e02d7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787790976.499040:0:19467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170e02d7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787790976.499042:0:19467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170e02d7800 3 00010000:00080000:1.0:1787790976.499304:0:19467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc46a2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790976.501409:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787790976.501663:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787790976.501749:0:19467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787790976.501762:0:19467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf9477fddcf1ee1d 00000100:00080000:1.0:1787790976.501772:0:19467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790976.501778:0:19467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc46a2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790976.501812:0:19467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbebda40 x1874634268139008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787790976.501832:0:19467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787790976.501880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790976.501885:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790976.501888:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790976.501891:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790976.501921:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790976.501924:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787790976.501932:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787790976.501937:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1787790976.501940:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787790976.501944:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170d6153000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790976.501957:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbe88b40 x1874634268139648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790976.502028:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268139136:0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.502042:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268139264:0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.502102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790976.502146:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268139904:0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.502168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790976.502191:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787790976.502197:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268139392:0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.502221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.502242:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268139008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790976.502243:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268140032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.502274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.502295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.502325:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268139648:0@lo:8:kworker.0 00000100:00100000:2.0:1787790976.502348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.502458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.502514:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268139776:0@lo:400:kworker.0 00000100:00100000:1.0:1787790976.502540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.502566:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139392 00000100:00100000:2.0:1787790976.502573:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139392 00000100:00100000:2.0:1787790976.502615:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139136 00000100:00100000:2.0:1787790976.502618:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139136 00000100:00100000:2.0:1787790976.502639:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787790976.502647:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268139392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790976.502699:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268139392:12345-0@lo:400:kworker.0 Request processed in 53us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.502734:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787790976.502749:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787790976.502755:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268139136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790976.502783:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268139136:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.502789:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787790976.503033:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139264 00000100:00100000:0.0:1787790976.503038:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139264 00000100:00100000:1.0:1787790976.503062:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268139136:0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.503063:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139904 00000100:00100000:0.0:1787790976.503068:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139904 00000100:00100000:0.0:1787790976.503214:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140032 00000100:00100000:0.0:1787790976.503218:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140032 00000100:00100000:1.0:1787790976.503239:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1787790976.503248:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790976.503252:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268139520:0@lo:400:kworker.0 00000100:00080000:2.0:1787790976.503254:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790976.503285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.503329:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139008 00000100:00100000:0.0:1787790976.503330:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139776 00000100:00100000:1.0:1787790976.503333:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139008 00000100:00100000:0.0:1787790976.503336:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139776 00000100:00100000:1.0:1787790976.503354:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787790976.503361:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790976.503367:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268139264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.503373:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268139008:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787790976.503396:0:17134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:1.0:1787790976.503403:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268139264:12345-0@lo:400:kworker.0 Request processed in 41us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.503411:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787790976.503425:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000020:00000080:0.0:1787790976.503429:0:17134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf9477fddcf1ee24 00000100:00100000:1.0:1787790976.503433:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268139904:12345-0@lo:400:kworker.0 00000004:00100000:0.0:1787790976.503448:0:17134:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787790976.503465:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268139904:12345-0@lo:400:kworker.0 Request processed in 33us (1295us total) trans 0 rc 0/0 00000100:00080000:0.0:1787790976.503478:0:17134:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790976.503484:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787790976.503500:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787790976.503509:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268140032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790976.503533:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874634268139008:12345-0@lo:38:llog_process_th.0 Request processed in 161us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790976.503543:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790976.503549:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268140032:12345-0@lo:400:kworker.0 Request processed in 41us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.503556:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787790976.503563:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790976.503571:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268139776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790976.503579:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139648 00000100:00100000:1.0:1787790976.503584:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139648 00000100:00100000:1.0:1787790976.503604:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268139520 00000100:00100000:1.0:1787790976.503607:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268139520 00000100:00100000:0.0:1787790976.503619:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268139776:12345-0@lo:400:kworker.0 Request processed in 48us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790976.503626:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787790976.503675:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790976.503681:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874634268139648:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787790976.503753:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874634268139648:12345-0@lo:8:kworker.0 Request processed in 72us (1403us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787790976.503759:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787790976.503812:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbebda40 x1874634268139008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790976.503822:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790976.503828:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787790976.503834:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787790976.503839:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787790976.503841:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787790976.503846:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268139008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787790976.503856:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787790976.503859:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787790976.503862:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787790976.503864:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268139648:0@lo:8:kworker.0 00000100:00100000:0.0:1787790976.503890:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268139392:0@lo:400:kworker.0 00010000:00080000:0.0:1787790976.503900:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe892c0 x1874634268140032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790976.503909:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268140032:0@lo:400:kworker.0 00010000:00080000:0.0:1787790976.503924:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc4595a40 x1874634268139264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790976.503931:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268139264:0@lo:400:kworker.0 00010000:00080000:0.0:1787790976.503939:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe89680 x1874634268139904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790976.503946:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268139904:0@lo:400:kworker.0 00010000:00080000:0.0:1787790976.504064:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe88780 x1874634268139776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790976.504083:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268139776:0@lo:400:kworker.0 00000100:00100000:1.0:1787790976.504278:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787790976.504288:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268139520:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787790976.504340:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790976.504390:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268139520:12345-0@lo:400:kworker.0 Request processed in 103us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.504398:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787790976.504534:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbe88f00 x1874634268139520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790976.504550:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268139520:0@lo:400:kworker.0 00000020:01000004:1.0:1787790976.504748:0:19467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787790976.504762:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9170eef319b8) 00000020:00000080:1.0:1787790976.504779:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787790976.504843:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170e02d7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787790976.504847:0:19467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170e02d7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787790976.504854:0:19467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170e02d7800 3 00010000:00080000:1.0:1787790976.504882:0:19467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc46a6000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787790976.508233:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787790976.508972:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787790976.509281:0:19467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787790976.509294:0:19467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf9477fddcf1ee32 00000100:00080000:1.0:1787790976.509305:0:19467:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787790976.509320:0:19467:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff916fc46a6000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787790976.509359:0:19467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170f67f0b40 x1874634268140160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787790976.509513:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268140160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787790976.509613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.509695:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140160 00000100:00100000:1.0:1787790976.509702:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140160 00000100:00100000:1.0:1787790976.509921:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790976.509931:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634268140160:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787790976.509956:0:17136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1787790976.509998:0:17136:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf9477fddcf1ee39 00000004:00100000:1.0:1787790976.510015:0:17136:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787790976.510046:0:17136:0:(import.c:65:import_set_state_nolock()) ffff916fc46a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790976.510690:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874634268140160:12345-0@lo:38:llog_process_th.0 Request processed in 757us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.510699:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787790976.510758:0:19467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787790976.510892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790976.510897:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787790976.510899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787790976.510902:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1787790976.510996:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170f67f0b40 x1874634268140160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787790986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787790976.511008:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787790976.511015:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787790976.511023:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787790976.511027:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787790976.511029:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc46a6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787790976.511035:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268140160:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787790976.511514:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787790976.511990:0:19454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787790976.512025:0:19454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787790976.512045:0:19454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.512056:0:19454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787790976.512298:0:19454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787790976.512301:0:19454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787790976.512302:0:19454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790976.512304:0:19454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790976.512305:0:19454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790976.512307:0:19454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790976.512309:0:19454:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790976.512311:0:19454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790976.512313:0:19454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787790976.512318:0:19454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787790976.512321:0:19454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787790976.512322:0:19454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787790976.512323:0:19454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787790976.512324:0:19454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787790976.512325:0:19454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787790976.512326:0:19454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787790976.512328:0:19454:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787790976.512329:0:19454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787790976.512329:0:19454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787790976.512352:0:19454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787790976.512369:0:19454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268140288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787790976.512513:0:19454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790976.512555:0:19454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787790976.512619:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140288 00000100:00100000:0.0:1787790976.512626:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140288 00000100:00100000:2.0:1787790976.513152:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787790976.513163:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268140288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787790976.513190:0:17128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787790976.513204:0:17128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787790976.520561:0:17128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787790976.520582:0:17128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787790976.520774:0:17150:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787790976.520779:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787790976.520798:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.520812:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.520826:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.520831:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.520860:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.520870:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790976.520881:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268140416:0@lo:104: 00000100:00100000:2.0:1787790976.520938:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790976.520998:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.521007:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 24 pid: 17127 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790976.521015:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268140544:0@lo:104: 00000100:00100000:1.0:1787790976.521031:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140416 00000100:00100000:2.0:1787790976.521037:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.521038:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140416 00000100:00100000:2.0:1787790976.521053:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc38a0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790976.521070:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140544 00000100:00100000:1.0:1787790976.521233:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140544 00000100:00100000:1.0:1787790976.521253:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790976.521261:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:17150:x1874634268140416:12345-0@lo:104: 00010000:00010000:1.0:1787790976.521274:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.521330:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787790976.521336:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:17150:x1874634268140416:12345-0@lo:104: Request processed in 75us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790976.521339:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:19454:x1874634268140288:12345-0@lo:253:mount.lustre.0 Request processed in 8178us (8826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.521343:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787790976.521347:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787790976.521359:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790976.521364:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268140544:12345-0@lo:104: 00010000:00010000:1.0:1787790976.521371:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.521446:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787790976.521452:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:17150:x1874634268140544:12345-0@lo:104: Request processed in 88us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.521459:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790976.521508:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268140416:0@lo:104: 00000100:00100000:1.0:1787790976.521517:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17150:1874634268140544:0@lo:104: 00010000:00010000:1.0:1787790976.521536:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.521624:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790976.521631:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790976.521633:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790976.521643:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787790976.521647:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.521655:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787790976.521661:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790976.521666:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787790976.521677:0:19454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:19454:1874634268140288:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787790976.521687:0:19454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787790976.521690:0:19454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:2.0:1787790976.521691:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787790976.521692:0:19454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787790976.521693:0:19454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787790976.521695:0:19454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787790976.521697:0:19454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:2.0:1787790976.521698:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1787790976.521730:0:19454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787790976.521732:0:19454:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787790976.521734:0:19454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787790976.521736:0:19454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787790976.521748:0:19454:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787790976.521883:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268140672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790976.521914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787790976.521969:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.521985:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4a00/0xcf9477fddcf1edbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1edc2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.522000:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790976.522002:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790976.522003:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790976.523088:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140672 00000100:00100000:1.0:1787790976.523097:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140672 00010000:00010000:1.0:1787790976.523120:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790976.523212:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790976.523228:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268140672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790976.523241:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790976.523247:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.523258:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.523273:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad4400/0xcf9477fddcf1edc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1edbb expref: 24 pid: 17129 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.523286:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790976.523334:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:3638:x1874634268140672:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.523340:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787790976.523613:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268140672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790976.524181:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790976.524185:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790976.524187:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790976.524548:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.524555:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790976.524557:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.524563:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790976.524568:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790976.524572:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787790976.524606:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.524621:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790976.524638:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.524646:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5c00/0xcf9477fddcf1edad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1edb4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790976.524654:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787790976.524661:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790976.524663:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790976.524664:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790976.524666:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268140800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790976.525122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790976.525200:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140800 00000100:00100000:1.0:1787790976.525205:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140800 00010000:00010000:1.0:1787790976.525223:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 23 pid: 17127 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790976.525248:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790976.525256:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:3638:x1874634268140800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790976.525266:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790976.525271:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 23 pid: 17127 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525280:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 23 pid: 17127 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525289:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1edb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1edad expref: 23 pid: 17127 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525298:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525312:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787790976.525326:0:17120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005348064s 00010000:00010000:1.0:1787790976.525331:0:17120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525338:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525344:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525351:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525357:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790976.525361:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525368:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525390:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790976.525401:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790976.525433:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:3638:x1874634268140800:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790976.525439:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787790976.525459:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268140800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790976.525547:0:17150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.525560:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790976.525564:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1ee40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787790976.530194:0:19454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787790976.532177:0:19454:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787790976.532186:0:19454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787790976.532222:0:19454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787790976.532256:0:19454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787790976.532272:0:19454:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787790976.532292:0:19454:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787790976.533337:0:19454:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787790976.533556:0:19454:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787790977.294522:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787790977.530073:0:19521:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787790977.530219:0:19521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787790977.749226:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790977.749238:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce839000 from 10 10000000:01000000:0.0:1787790977.749243:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790977.749312:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.749327:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.749339:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790977.749370:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268140928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790977.749450:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790977.749494:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8090b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790977.749516:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268140928 00000100:00100000:0.0:1787790977.749535:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268140928 00000100:00100000:0.0:1787790977.749806:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787790977.749818:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268140928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790977.749833:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790977.749859:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad4a00/0xcf9477fddcf1ee4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ee47 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.749884:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad4a00/0xcf9477fddcf1ee4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ee47 expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.749895:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad4a00/0xcf9477fddcf1ee4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ee47 expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.749903:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad4a00, rc 0) 00000100:00100000:0.0:1787790977.749944:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268140928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790977.749952:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787790977.750014:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268140928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790977.750030:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.750040:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790977.750092:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268141056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787790977.750136:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790977.750154:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8090b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790977.750795:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141056 00000100:00100000:0.0:1787790977.750802:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141056 00000100:00100000:0.0:1787790977.750834:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787790977.750841:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268141056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787790977.750858:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790977.750880:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790977.750883:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787790977.750983:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268141056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790977.750991:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787790977.751033:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268141056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787790977.751095:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790977.751104:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751184:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790977.751197:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787790977.751200:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff916fc46e5000 from 10 10000000:01000000:0.0:1787790977.751203:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787790977.751231:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751239:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751248:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790977.751264:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268141184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790977.751303:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790977.751328:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8090b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787790977.751341:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141184 00000100:00100000:0.0:1787790977.751351:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141184 00000100:00100000:0.0:1787790977.751373:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787790977.751378:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268141184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790977.751386:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790977.751395:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1ee5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1ee55 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751411:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1ee5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1ee55 expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751419:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1ee5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ee55 expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751427:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3ad5c00, rc 0) 00000100:00100000:0.0:1787790977.751454:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268141184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790977.751460:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787790977.751487:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268141184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790977.751498:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.751506:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790977.751810:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268141312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787790977.751838:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790977.751851:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790977.751863:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141312 00000100:00100000:0.0:1787790977.751873:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141312 00000100:00100000:0.0:1787790977.751896:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787790977.751901:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268141312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787790977.751912:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787790977.751923:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787790977.751926:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787790977.752000:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268141312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790977.752006:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787790977.752034:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268141312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787790977.752073:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787790977.752079:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790977.752086:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790977.868824:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268141440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790977.868894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790977.868950:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141440 00000100:00100000:0.0:1787790977.868957:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141440 00000100:00100000:0.0:1787790977.869019:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787790977.869028:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268141440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790977.869056:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787790977.869112:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268141440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790977.869119:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787790977.869197:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4588b40 x1874634268141440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790977.869215:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268141440:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787790978.314978:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790978.379876:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268141568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790978.379946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790978.380020:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141568 00000100:00100000:3.0:1787790978.380027:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141568 00000100:00100000:3.0:1787790978.380074:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790978.380083:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268141568:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787790978.380210:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787790978.380219:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268141696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790978.380246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1787790978.380299:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787790978.380423:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268141568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 340us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790978.380431:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787790978.380448:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141696 00000100:00100000:3.0:1787790978.380451:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141696 00000100:00100000:3.0:1787790978.380467:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790978.380473:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268141696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790978.380490:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790978.380598:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268141696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.380722:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268141568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790978.380784:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787790978.380828:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268141696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790978.574099:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790958/real 1787790958] req@ffff9170fbe8b840 x1874634268127488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.574129:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170fbe8b840 x1874634268127488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.574139:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787790958/real 1787790958] req@ffff9170fbe8b0c0 x1874634268127616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.574150:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170fbe8b0c0 x1874634268127616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787790978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790978.574169:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790978.574191:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787790978.574195:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268127488:0@lo:8:kworker.0 00000100:00080000:1.0:1787790978.574202:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787790978.574207:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787790978.574210:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268127616:0@lo:8:kworker.0 00000100:00080000:0.0:1787790978.574330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790978.574335:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787790978.574338:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790978.574343:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1787790978.574348:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787790978.574355:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170d6142800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790978.574376:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc458a940 x1874634268141952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790978.574387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790978.574390:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787790978.574392:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790978.574395:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1787790978.574397:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787790978.574400:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170d6145800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790978.574412:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc4588f00 x1874634268142080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787790978.574453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787790978.574456:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787790978.574457:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787790978.574462:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170d6153000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787790978.574472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc458b0c0 x1874634268142464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787790978.574635:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268142592:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.574731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.574765:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268143104:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.574791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.574820:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787790978.574826:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268141824:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.574853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.574891:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268142720:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.574915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.574939:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268142336:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.574976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.574996:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268142976:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.575034:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787790978.575039:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268142208:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.575067:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268142848:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.575104:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142592 00000100:00100000:1.0:1787790978.575110:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142592 00000100:00100000:1.0:1787790978.575142:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143104 00000100:00100000:1.0:1787790978.575145:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143104 00000100:00100000:1.0:1787790978.575167:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142720 00000100:00100000:1.0:1787790978.575169:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142720 00000100:00100000:1.0:1787790978.575181:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142976 00000100:00100000:1.0:1787790978.575183:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142976 00000100:00100000:1.0:1787790978.575193:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142208 00000100:00100000:1.0:1787790978.575195:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142208 00000100:00100000:1.0:1787790978.575204:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142848 00000100:00100000:1.0:1787790978.575206:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142848 00000100:00100000:1.0:1787790978.575221:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790978.575228:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268142592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575278:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268142592:12345-0@lo:400:kworker.0 Request processed in 50us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575286:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787790978.575304:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787790978.575309:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268143104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575334:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268143104:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575339:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787790978.575350:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790978.575356:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268142720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575380:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268142720:12345-0@lo:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575386:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787790978.575397:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790978.575403:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268142976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575446:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268142976:12345-0@lo:400:kworker.0 Request processed in 43us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575452:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787790978.575464:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790978.575470:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268142208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575494:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268142208:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575499:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787790978.575511:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790978.575517:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268142848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575546:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268142848:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575552:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787790978.575568:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141824 00000100:00100000:1.0:1787790978.575570:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141824 00000100:00100000:1.0:1787790978.575594:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787790978.575600:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268141824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575627:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268141824:12345-0@lo:400:kworker.0 Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575633:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787790978.575758:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142336 00000100:00100000:1.0:1787790978.575762:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142336 00000100:00100000:1.0:1787790978.575791:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790978.575797:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268142336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.575828:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268142336:12345-0@lo:400:kworker.0 Request processed in 31us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.575834:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787790978.575863:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268141952:0@lo:8:kworker.0 00000100:00100000:1.0:1787790978.575890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.575908:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268142080:0@lo:8:kworker.0 00000100:00100000:1.0:1787790978.575929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.575944:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268142464:0@lo:8:kworker.0 00000100:00100000:1.0:1787790978.575983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.576011:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268141952 00000100:00100000:1.0:1787790978.576015:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268141952 00000100:00100000:1.0:1787790978.576031:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142080 00000100:00100000:1.0:1787790978.576039:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142080 00000100:00100000:1.0:1787790978.576050:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268142464 00000100:00100000:1.0:1787790978.576053:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268142464 00000100:00100000:1.0:1787790978.576062:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790978.576066:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874634268141952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787790978.576091:0:18643:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1787790978.576118:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1ee63 00002000:00100000:1.0:1787790978.576133:0:18643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff916fc46a2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787790978.576138:0:18643:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787790978.576141:0:18643:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790978.576220:0:18643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787790978.576242:0:18643:0:(import.c:65:import_set_state_nolock()) ffff916fc46a1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790978.576277:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634268141952:12345-0@lo:8:kworker.0 Request processed in 209us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.576284:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790978.576295:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790978.576299:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874634268142080:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787790978.576312:0:18643:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1787790978.576325:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1ee6a 00002000:00100000:1.0:1787790978.576330:0:18643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff916fc46a4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787790978.576333:0:18643:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787790978.576335:0:18643:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790978.576476:0:18643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787790978.576491:0:18643:0:(import.c:65:import_set_state_nolock()) ffff916fc46a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790978.576519:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634268142080:12345-0@lo:8:kworker.0 Request processed in 218us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.576525:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790978.576545:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790978.576549:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874634268142464:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787790978.576563:0:18643:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1787790978.576579:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1ee71 00002000:00100000:1.0:1787790978.576584:0:18643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff916fc46a7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787790978.576588:0:18643:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787790978.576590:0:18643:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787790978.576611:0:18643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787790978.576621:0:18643:0:(import.c:65:import_set_state_nolock()) ffff916fc46a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790978.576645:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634268142464:12345-0@lo:8:kworker.0 Request processed in 94us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.576651:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787790978.576695:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458a1c0 x1874634268142208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576731:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268142208:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576743:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45970c0 x1874634268142848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576750:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268142848:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576759:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4588b40 x1874634268142336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576767:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268142336:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576777:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe8b0c0 x1874634268142976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576785:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268142976:0@lo:400:kworker.0 00000100:00100000:1.0:1787790978.576832:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268141824:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576844:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4595a40 x1874634268142720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576853:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4595a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268142720:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576862:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4589e00 x1874634268142592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576871:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268142592:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576881:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe8b840 x1874634268143104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576889:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268143104:0@lo:400:kworker.0 00010000:00080000:1.0:1787790978.576919:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458a940 x1874634268141952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.576926:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790978.576932:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787790978.576941:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787790978.576946:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787790978.576949:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787790978.576984:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787790978.576989:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268141952:0@lo:8:kworker.0 00010000:00080000:1.0:1787790978.577003:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4588f00 x1874634268142080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.577009:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787790978.577013:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787790978.577023:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787790978.577026:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787790978.577028:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787790978.577039:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787790978.577043:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268142080:0@lo:8:kworker.0 00010000:00080000:1.0:1787790978.577053:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458b0c0 x1874634268142464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787790978.577060:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787790978.577064:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787790978.577066:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787790978.577068:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787790978.577076:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787790978.577079:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268142464:0@lo:8:kworker.0 00000004:00080000:1.0:1787790978.577125:0:17161:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1787790978.577142:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17161:1874634268143360:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787790978.577165:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.577179:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790978.577187:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790978.577192:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268143232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790978.577209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.577236:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143232 00000100:00100000:1.0:1787790978.577239:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143232 00000100:00100000:1.0:1787790978.577262:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787790978.577268:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268143232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790978.577286:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787790978.577316:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268143232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.577327:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787790978.577351:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170f67f2d00 x1874634268143232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.577363:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268143232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787790978.577376:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143360 00000100:00100000:1.0:1787790978.577378:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143360 00000100:00100000:1.0:1787790978.577396:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790978.577401:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17161:x1874634268143360:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787790978.577843:0:17160:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787790978.577908:0:17160:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 527526202332ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787790978.577913:0:17160:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787790978.578987:0:17878:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787790978.579011:0:17878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17878:1874634268143616:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787790978.579059:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790978.579082:0:17878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81840 going to sleep for 11 seconds 00000004:00080000:3.0:1787790978.579095:0:17877:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787790978.579147:0:17877:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 527527441713ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787790978.579153:0:17877:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787790978.579178:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143616 00000100:00100000:3.0:1787790978.579184:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143616 00000100:00100000:3.0:1787790978.579217:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787790978.579222:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17878:x1874634268143616:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787790978.579279:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268143488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790978.579299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790978.580864:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143488 00000100:00100000:3.0:1787790978.580872:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143488 00000100:00100000:3.0:1787790978.580906:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787790978.580911:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1874634268143488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790978.580949:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787790978.581017:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1874634268143488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790978.581024:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787790978.581101:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d43c0 x1874634268143488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790978.581119:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268143488:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1787790978.581949:0:17159:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787790978.581981:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17159:1874634268143872:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787790978.582028:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790978.582050:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81480 going to sleep for 11 seconds 00000100:00080000:3.0:1787790978.582064:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790978.582069:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790978.582073:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790978.582086:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790978.582120:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787790978.582130:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268143744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790978.582156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790978.582334:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143744 00000100:00100000:3.0:1787790978.582340:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143744 00000100:00100000:3.0:1787790978.582387:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787790978.582395:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268143744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790978.582410:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787790978.582489:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790978.582552:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268143744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790978.582560:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787790978.582618:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d61c0 x1874634268143744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787790994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790978.582628:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268143744:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787790978.583094:0:17158:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787790978.583199:0:17158:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 527531492979ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787790978.583206:0:17158:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787790978.584384:0:19281:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787790978.584394:0:19281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787790978.584501:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787790978.584509:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268143872 00000100:00100000:1.0:1787790978.584515:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268143872 00000004:00080000:3.0:1787790978.585234:0:17867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787790978.585521:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790978.585533:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17159:x1874634268143872:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787790978.589468:0:17114:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787790978.589486:0:17114:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787790978.590751:0:19573:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787790978.590760:0:19573:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787790978.590764:0:19573:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:1.0:1787790978.615345:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.615357:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.615374:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.615379:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.615386:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.615412:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.615423:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.615431:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.615545:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790978.615558:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790978.615567:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.615576:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.615582:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.615591:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.615614:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.615622:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1ee78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.615640:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.615648:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.615650:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787790978.615659:0:18640:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787790978.615664:0:18640:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787790978.615832:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17878:x1874634268143616:12345-0@lo:7:osp-pre-1-1.0 Request processed in 36544us (36708us total) trans 0 rc 0/0 00002000:00080000:0.0:1787790978.615844:0:18643:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00000100:00100000:3.0:1787790978.615845:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787790978.615904:0:17878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d6d00 x1874634268143616/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787790994 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1787790978.615912:0:18643:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787790978.615919:0:18643:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:3.0:1787790978.615920:0:17878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17878:1874634268143616:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787790978.615937:0:17878:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787790978.615993:0:17878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17878:1874634268144000:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787790978.616030:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790978.616060:0:17878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81840 going to sleep for 11 seconds 00000100:00100000:1.0:1787790978.616060:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144000 00000100:00100000:1.0:1787790978.616069:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144000 00000100:00100000:1.0:1787790978.617053:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790978.617067:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17878:x1874634268144000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787790978.617094:0:18642:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787790978.617149:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17878:x1874634268144000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 86us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.617157:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787790978.617170:0:17878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d6d00 x1874634268144000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787790994 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790978.617179:0:17878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17878:1874634268144000:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787790978.617189:0:17878:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00002000:00010000:1.0:1787790978.617233:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.617242:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617258:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.617263:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.617269:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790978.617273:0:17878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17878:1874634268144128:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1787790978.617314:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790978.617321:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790978.617336:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790978.617345:0:17878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf81840 going to sleep for 11 seconds 00000100:00100000:3.0:1787790978.617359:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144128 00000100:00100000:3.0:1787790978.617363:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144128 00000100:00100000:3.0:1787790978.617390:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790978.617408:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17878:x1874634268144128:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787790978.617434:0:18640:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:1.0:1787790978.617534:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617554:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.617565:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.617593:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617605:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.617609:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617618:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617642:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617651:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c46766f/0xcf9477fddcf1ee7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.617674:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.617676:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.617678:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.618591:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.618600:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618613:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.618618:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.618624:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618635:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618643:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618650:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618667:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.618676:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.618680:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618701:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.618726:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618736:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618750:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618758:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ead7ef2/0xcf9477fddcf1ee86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.618786:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.618788:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.618789:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.619368:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.619375:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.619385:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.619389:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.619395:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.619405:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.619420:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.619427:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.619520:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790978.620872:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790978.620880:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.620889:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbc00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.620892:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.620899:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.620913:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.620918:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df000041/0xcf9477fddcf1ee8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.620935:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.620936:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.620937:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.621382:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.621390:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.621402:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.621414:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.621421:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.621444:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.621453:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.621460:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.621484:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.621892:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.621899:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.621906:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.621910:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.621918:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.621932:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.621939:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1ee94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.621955:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.621973:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.621975:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.622165:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.622172:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.622180:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.622183:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.622188:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.622209:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.622217:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.622224:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.622245:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.624206:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.624217:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624231:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.624235:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624246:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624268:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624276:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1ee9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624299:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.624302:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.624311:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.624348:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.624466:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.624480:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.624484:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.624498:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.624518:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.624534:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.624543:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.624580:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.624671:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.624678:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624688:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26faa00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.624691:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624700:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624730:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624737:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1eea2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.624750:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.624751:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.624753:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.625327:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.625334:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.625345:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.625348:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.625555:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.625567:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.625577:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.625602:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.625767:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.625830:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.625836:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.625844:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fae00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.625860:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.625881:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.625897:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.625905:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5f5efb/0xcf9477fddcf1eea9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.625923:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.625926:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.625929:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.627036:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.627045:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.627169:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.627174:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.627180:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.627200:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.627209:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.627216:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.627233:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.627241:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.627248:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.627258:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.627263:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.627274:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.627289:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.627310:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dfb722b/0xcf9477fddcf1eeb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.627329:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.627332:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.627334:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.629650:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.629671:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.629695:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.629729:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.629737:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.629750:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.629760:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.629769:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.629790:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.630215:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.630223:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.630232:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.630237:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.630247:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.630264:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.630272:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006742a8e9/0xcf9477fddcf1eeb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.630293:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.630295:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.630297:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.631042:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.631050:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.631062:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.631065:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.631071:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.631081:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.631090:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.631097:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.631114:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.631537:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.631545:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.631553:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.631557:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.631566:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.631596:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.631604:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1eebe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.631627:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.631629:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.631631:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.637134:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.637164:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637184:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.637189:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.637197:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637213:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637224:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637233:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637329:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.637342:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.637348:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637356:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.637361:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637371:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637388:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637396:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a688568/0xcf9477fddcf1eec5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.637416:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.637681:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.637684:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790978.638041:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787790978.638049:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638059:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1787790978.638063:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790978.638075:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638109:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638119:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638132:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638150:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790978.638164:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790978.638169:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638176:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790978.638186:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638194:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638207:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638214:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eef5c81f/0xcf9477fddcf1eecc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.638244:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790978.638246:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790978.638248:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790978.642218:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787790978.642234:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.642254:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1787790978.642259:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790978.642267:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.642282:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.642292:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.642300:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.642336:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.642346:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.642355:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.642366:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.642376:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.642387:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.642411:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.642545:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000450f467f/0xcf9477fddcf1eed3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.642568:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.642570:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.642572:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.643799:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.643809:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.643822:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.643826:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.643833:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.643874:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.643884:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.643893:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.643916:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.643946:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.643955:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.643974:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.643978:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.643989:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.644008:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.644024:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1eeda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.644042:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.644044:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.644046:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.644229:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.644237:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644245:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.644248:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.644252:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644263:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644272:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644290:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644307:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.644584:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.644590:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.644662:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.644668:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.644677:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.644690:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.644697:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1eee1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.644751:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.644754:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.644757:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.644939:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.644946:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644955:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.644969:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.644973:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644987:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.644996:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.645002:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.645021:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.645028:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.645035:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645049:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.645054:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645062:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645076:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645083:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1eee8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645097:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.645099:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.645101:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.645129:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.645134:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645143:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.645146:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.645151:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645161:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645169:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645175:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.645191:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.646016:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.646023:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.646030:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102179e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.646033:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.646049:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.646060:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.646064:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009521e420/0xcf9477fddcf1eeef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.646079:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.646080:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.646082:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.648078:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.648089:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.648111:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.648114:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.648119:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.648129:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.648136:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.648148:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.648163:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790978.649233:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.649240:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649248:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.649251:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.649254:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649262:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649268:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649272:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649288:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790978.649296:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790978.649300:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649311:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102179a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.649315:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649321:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649332:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649337:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002770ee6f/0xcf9477fddcf1eef6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649351:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.649353:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649358:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917102178a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.649360:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649364:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649370:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649378:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b1e2c5/0xcf9477fddcf1eefd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649403:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.649405:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.649406:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.649580:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.649588:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.649604:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.649607:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.649612:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.649624:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.649632:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.649639:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.649665:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.649691:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.649696:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649717:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.649720:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649725:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649734:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649739:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1ef04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.649750:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.649751:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.649752:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.649998:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.650002:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650008:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.650011:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.650013:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650019:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650024:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650028:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650040:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790978.650246:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.650250:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650256:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.650258:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.650260:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650274:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650279:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650283:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650291:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790978.650296:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790978.650299:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650302:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.650304:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650309:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650316:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650319:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000849961a5/0xcf9477fddcf1ef0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650333:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.650335:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650339:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.650341:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650345:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650349:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650353:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650358:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.650359:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.650361:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.650481:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.650567:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.650571:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650577:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.650583:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.650586:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650593:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650597:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650602:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.650617:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790978.651033:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.651038:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651044:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.651046:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.651049:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651055:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651060:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651069:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651076:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787790978.651204:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.651208:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651214:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.651215:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.651218:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651224:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651229:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651233:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651238:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787790978.651338:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787790978.651346:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651356:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.651360:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651369:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651390:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651397:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7904c78/0xcf9477fddcf1ef19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651412:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787790978.651415:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651435:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.651438:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651445:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651455:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651462:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1ef20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651479:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790978.651483:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651494:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.651497:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651503:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651517:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651524:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1ef27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651536:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.651537:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.651539:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.651544:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.651626:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.651641:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651658:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.651662:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1787790978.651664:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.651666:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651672:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651681:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651684:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.651695:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651699:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.651728:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651743:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.651749:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.651751:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651756:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.651758:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651763:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651778:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651783:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651784:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.651795:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.651796:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.651797:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.651814:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651824:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651833:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651847:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787790978.651915:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787790978.651920:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651927:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.651934:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651942:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651956:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651972:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.651991:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.651993:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790978.651995:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.653019:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.653029:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653037:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.653040:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.653045:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653052:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653062:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653067:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653085:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.653354:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.653361:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.653370:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.653374:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.653383:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.653397:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.653404:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1ef3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790978.653676:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.653680:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653687:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.653689:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.653693:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653700:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653722:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653728:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653742:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.653750:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.653753:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653758:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787790978.653759:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.653766:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653772:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653780:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653785:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.653797:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.653798:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.653800:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.653814:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.653821:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.653831:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.653834:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.653839:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790978.654062:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.654069:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654078:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.654081:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.654085:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654095:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654104:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654119:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654134:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.654142:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.654146:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654153:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.654157:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654165:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654179:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654187:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654201:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.654203:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.654204:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.654441:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.654453:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654461:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.654464:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.654467:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654475:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.654606:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.654609:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.654611:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.654876:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654881:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.654896:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.655382:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.655389:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.655409:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.655413:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.655640:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.655651:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.655657:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.655679:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787790978.656029:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.656030:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.656039:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.656049:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.656055:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.656056:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.656080:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008412ff37/0xcf9477fddcf1ef58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.656082:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.656100:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.656103:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.656105:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.656106:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.656115:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1ef4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.656133:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.656134:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.656136:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.660610:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.660624:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.660653:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.660658:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.660664:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.660678:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.660689:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790978.660693:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.660698:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.660703:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.660743:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.660746:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.660747:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.660752:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.660764:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.660771:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.660778:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.660803:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787790978.661168:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787790978.661178:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661187:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.661203:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661215:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661242:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661251:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1ef5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661270:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790978.661275:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661282:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790978.661286:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661295:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661319:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661328:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee677e29/0xcf9477fddcf1ef66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.661345:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.661347:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.661356:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.661363:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787790978.662584:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787790978.662593:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.662664:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1787790978.662668:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790978.662674:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.662687:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.662769:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.662778:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790978.662794:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.662816:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.662824:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.662834:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.662839:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.662847:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.662861:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.662868:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1ef6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.662883:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.662885:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.662886:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.663018:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.663024:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.663033:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.663041:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.663046:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.663056:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.663063:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.663070:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.663088:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787790978.663693:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787790978.663701:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.663753:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790978.663757:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.663766:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.663780:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.663788:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1ef74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.663805:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790978.663807:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790978.663810:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.664281:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.664287:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664297:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.664300:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.664305:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664316:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664324:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664339:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664352:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787790978.664540:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787790978.664546:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.664554:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1787790978.664558:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790978.664562:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.664573:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.664589:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.664596:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787790978.664612:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.664617:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.664625:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.664625:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.664628:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.664634:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664642:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.664646:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.664652:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.664653:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664664:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.664672:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664688:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.664701:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.664727:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790978.664729:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787790978.664737:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790978.664741:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.664747:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1ef7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664761:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.664766:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664772:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664780:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664785:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef5c81f/0xcf9477fddcf1ef82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664799:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.664802:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664806:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.664808:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664813:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664818:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664827:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1ef89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.664835:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.664836:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.664839:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.664842:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.664844:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.664845:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.664848:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.665185:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.665193:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665257:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.665260:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.665263:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665271:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665277:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665282:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665292:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.665303:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.665306:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665310:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.665312:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665317:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665323:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665328:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd53b19e/0xcf9477fddcf1ef90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.665337:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.665338:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.665338:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790978.665539:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787790978.665545:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.665553:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1787790978.665555:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790978.665559:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.665568:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.665575:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.665582:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.666040:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.666122:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.666128:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666137:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.666140:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666158:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666172:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666179:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002590b2f6/0xcf9477fddcf1ef97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666194:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.666195:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.666197:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787790978.666735:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.666743:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666754:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.666757:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.666763:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666775:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666782:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666795:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.666809:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787790978.667252:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.667259:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667269:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.667272:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.667276:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667285:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667293:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667300:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667316:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787790978.667324:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.667325:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790978.667333:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.667336:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.667358:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1787790978.667360:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787790978.667364:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.667366:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.667373:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667377:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.667395:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667403:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.667407:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667418:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000849961a5/0xcf9477fddcf1ef9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667448:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.667452:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667460:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.667463:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667471:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667481:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667496:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1efa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.667514:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.667517:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.667521:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.667686:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.667878:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.667884:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.667892:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.667900:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.667904:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.667912:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.667917:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.667922:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.667933:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.668223:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.668230:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668238:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.668242:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668250:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668263:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668270:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001897f1d1/0xcf9477fddcf1efb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668283:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.668285:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.668286:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787790978.668519:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.668537:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.668561:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.668567:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668576:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.668580:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668588:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.668996:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.669005:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000450f467f/0xcf9477fddcf1efac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.669142:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.669146:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.669148:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.669855:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.669861:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.669871:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.669874:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.669878:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.669885:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.669890:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.669899:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.669922:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.669944:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.669951:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.669972:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.669976:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.669994:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670007:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670013:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004baa71b/0xcf9477fddcf1efba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670028:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.670030:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.670031:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787790978.670272:0:19455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787790978.670306:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:0.0:1787790978.670307:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00100000:1.0:1787790978.670312:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787790978.670316:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.670326:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1787790978.670336:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790978.670341:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.670353:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.670362:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.670369:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.670387:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790978.670494:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17878:x1874634268144128:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53092us (53171us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787790978.670504:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787790978.670521:0:17878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787790978.670529:0:17878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17878:1874634268144128:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1787790978.670536:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.670543:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787790978.670544:0:17878:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00010000:00010000:1.0:1787790978.670556:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.670561:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670581:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670594:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670602:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cab5f7b/0xcf9477fddcf1efc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790978.670615:0:17878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17878:1874634268144256:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787790978.670619:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.670622:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.670624:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790978.670655:0:17878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790978.670684:0:17878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f39eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787790978.670749:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144256 00002000:00010000:2.0:1787790978.670751:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1787790978.670755:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144256 00010000:00010000:2.0:1787790978.670758:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.670768:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.670782:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.670787:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.670795:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790978.670799:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787790978.670807:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790978.670812:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17878:x1874634268144256:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1787790978.670824:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.670835:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790978.670868:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17878:x1874634268144256:12345-0@lo:900:osp-pre-1-1.0 Request processed in 58us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790978.670876:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787790978.670910:0:17878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5ae1c0 x1874634268144256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787790994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790978.670922:0:17878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ae1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17878:1874634268144256:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787790978.670946:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.670951:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670980:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.670983:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.670991:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671003:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671010:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000634efe77/0xcf9477fddcf1efc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671023:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.671024:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.671026:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.671329:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.671334:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671340:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.671343:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.671346:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671352:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671356:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671361:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671372:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.671394:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.671401:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671411:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.671415:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671423:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671503:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671511:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1efcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671524:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.671526:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.671528:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.671885:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.671891:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671904:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.671907:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.671912:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671921:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671936:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671942:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.671954:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.671985:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.671991:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.671999:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.672002:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672009:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672021:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672028:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000156f0086/0xcf9477fddcf1efd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672052:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.672054:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.672057:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787790978.672306:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787790978.672314:0:19573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.672324:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1787790978.672328:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790978.672333:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.672343:0:19573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.672351:0:19573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.672365:0:19573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790978.672383:0:19573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.672405:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.672412:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672420:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.672423:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787790978.672486:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787790978.672488:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672492:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672509:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.672511:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790978.672515:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672516:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672540:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672540:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1efdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672564:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672567:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.672571:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672571:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.672575:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790978.672588:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.672596:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.672602:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672622:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.672626:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672633:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672645:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672652:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcf53af7/0xcf9477fddcf1efe4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.672665:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.672667:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.672669:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787790978.672947:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.672951:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672968:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.672971:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.672976:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672985:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672992:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.672999:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.673033:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787790978.673231:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.673236:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.673245:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.673247:0:19471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.673253:0:19471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.673268:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.673273:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e87e17/0xcf9477fddcf1efeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.673285:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.673287:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.673288:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787790978.673535:0:19573:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1787790978.673805:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17159:x1874634268143872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 88270us (91771us total) trans 0 rc 0/0 00002000:00010000:2.0:1787790978.673811:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787790978.673817:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790978.673819:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787790978.673828:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17159:1874634268143872:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1787790978.673829:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1787790978.673836:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790978.673840:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.673847:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787790978.673852:0:17159:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00010000:00010000:2.0:1787790978.673853:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.673865:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790978.673875:0:18643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787790978.673911:0:18643:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1787790978.673912:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17159:1874634268144384:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787790978.673956:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17161:x1874634268143360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96552us (96788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790978.673983:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790978.673983:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.674014:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787790978.674025:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17161:1874634268143360:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787790978.674037:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144384 00000100:00100000:1.0:1787790978.674044:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144384 00000004:00080000:2.0:1787790978.674048:0:17161:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787790978.674072:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17161:1874634268144512:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787790978.674097:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790978.674097:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790978.674112:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17159:x1874634268144384:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787790978.674115:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f39ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1787790978.674126:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144512 00000100:00100000:2.0:1787790978.674128:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144512 00000100:00100000:2.0:1787790978.674145:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787790978.674150:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17161:x1874634268144512:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787790978.674154:0:18642:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00080000:2.0:1787790978.674169:0:18643:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1787790978.674273:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790978.674280:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.674288:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790978.674298:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.674306:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.674320:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.674327:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ea21a2/0xcf9477fddcf1eff2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790978.674341:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.674343:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790978.674345:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790978.677814:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17161:x1874634268144512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3654us (3710us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787790978.677830:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787790978.678003:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17161:1874634268144512:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787790978.678021:0:17161:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:1.0:1787790978.685956:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1787790978.686014:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787790978.686274:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17159:x1874634268144384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12161us (12292us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787790978.686286:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790978.686499:0:17159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787790978.686509:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17159:1874634268144384:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787790978.686525:0:17159:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:3.0:1787790979.276654:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790979.340396:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790980.362967:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790981.392057:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790982.413152:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790982.987884:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268144640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790982.987975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790982.990411:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144640 00000100:00100000:0.0:1787790982.990423:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144640 00000100:00100000:0.0:1787790982.990476:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787790982.990486:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268144640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790982.990516:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787790982.990593:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268144640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790982.990600:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787790982.990620:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790982.990663:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268144640:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787790983.077984:0:19812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787790983.435039:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790983.499211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268144768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790983.499288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790983.499439:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790983.499450:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268144896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790983.499479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790983.499526:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144768 00000100:00100000:1.0:1787790983.499533:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144768 00000100:00100000:1.0:1787790983.499572:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268144896 00000100:00100000:1.0:1787790983.499576:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268144896 00000100:00100000:1.0:1787790983.499594:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787790983.499602:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268144768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787790983.499635:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787790983.499681:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268144768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790983.499688:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787790983.499728:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787790983.499734:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4595a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268144896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787790983.499765:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787790983.499797:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4595a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268144896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790983.499803:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787790983.499845:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268144896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790983.500119:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268144768:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787790983.925294:0:19864:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787790983.925488:0:19864:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787790984.011610:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268145024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787790984.011680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790984.011732:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268145536:0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.011821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790984.011838:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268146048:0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.011857:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790984.011872:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268146560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787790984.011901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790984.011937:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787790984.011943:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268145408:0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.011964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790984.011978:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268145920:0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.011994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790984.012006:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268146432:0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.012022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012189:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268145152:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012244:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268145664:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012273:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268146176:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012295:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268146688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790984.012313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012329:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787790984.012334:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268145280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012361:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268145792:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012393:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268146304:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790984.012431:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145152 00000100:00100000:3.0:1787790984.012437:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145152 00000100:00100000:3.0:1787790984.012472:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787790984.012479:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268145152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.012519:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268145152:12345-0@lo:400:kworker.0 Request processed in 40us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790984.012525:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787790984.012566:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268145152:0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.012622:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145024 00000100:00100000:1.0:1787790984.012626:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145024 00000100:00100000:1.0:1787790984.012663:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146560 00000100:00100000:1.0:1787790984.012666:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146560 00000100:00100000:1.0:1787790984.012679:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146688 00000100:00100000:1.0:1787790984.012681:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146688 00000100:00100000:1.0:1787790984.012694:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790984.012700:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268145024:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787790984.012860:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145408 00000100:00100000:2.0:1787790984.012864:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145408 00000100:00100000:2.0:1787790984.012886:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145664 00000100:00100000:2.0:1787790984.012888:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145664 00000100:00100000:2.0:1787790984.012900:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145280 00000100:00100000:2.0:1787790984.012902:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145280 00000100:00100000:2.0:1787790984.012909:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145792 00000100:00100000:2.0:1787790984.012921:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145792 00000100:00100000:2.0:1787790984.012934:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790984.012942:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1874634268145408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790984.012982:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1874634268145408:12345-0@lo:400:kworker.0 Request processed in 42us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790984.012988:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787790984.013009:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790984.013014:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268145664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790984.013038:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268145664:12345-0@lo:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790984.013044:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787790984.013052:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00002000:00000024:1.0:1787790984.013168:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787790984.013198:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874634268145024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 498us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013204:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787790984.013215:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790984.013221:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268146560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787790984.013230:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787790984.013248:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268146560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013253:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787790984.013268:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790984.013272:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268146688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790984.013280:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787790984.013297:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268146688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013302:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787790984.013316:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145536 00000100:00100000:1.0:1787790984.013319:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145536 00000100:00100000:1.0:1787790984.013334:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146048 00000100:00100000:1.0:1787790984.013336:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146048 00000100:00100000:1.0:1787790984.013345:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268145920 00000100:00100000:1.0:1787790984.013347:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268145920 00000100:00100000:1.0:1787790984.013355:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146432 00000100:00100000:1.0:1787790984.013356:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146432 00000100:00100000:1.0:1787790984.013366:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146176 00000100:00100000:1.0:1787790984.013368:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146176 00000100:00100000:1.0:1787790984.013377:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146304 00000100:00100000:1.0:1787790984.013379:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146304 00000100:00100000:1.0:1787790984.013389:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790984.013394:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268145536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013416:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268145536:12345-0@lo:400:kworker.0 Request processed in 23us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013422:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787790984.013430:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787790984.013435:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268146048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013453:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268146048:12345-0@lo:400:kworker.0 Request processed in 18us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013458:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787790984.013466:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790984.013475:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268145920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013495:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268145920:12345-0@lo:400:kworker.0 Request processed in 21us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013500:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787790984.013509:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790984.013514:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268146432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013532:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268146432:12345-0@lo:400:kworker.0 Request processed in 18us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013537:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787790984.013545:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787790984.013549:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268146176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013570:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268146176:12345-0@lo:400:kworker.0 Request processed in 20us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013576:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787790984.013584:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790984.013589:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268146304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013607:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268146304:12345-0@lo:400:kworker.0 Request processed in 18us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013612:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787790984.013635:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787790984.013640:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268145792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790984.013661:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268145792:12345-0@lo:400:kworker.0 Request processed in 21us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790984.013667:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787790984.013824:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268145280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787790984.013851:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268145280:12345-0@lo:400:kworker.0 Request processed in 795us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790984.013857:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787790984.014142:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790984.014146:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787790984.014149:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787790984.014151:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790984.014183:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268145280:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.014192:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268145792:0@lo:400:kworker.0 00010000:00080000:3.0:1787790984.014204:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4547c00 x1874634268146304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790984.014214:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268146304:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.014222:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268145664:0@lo:400:kworker.0 00010000:00080000:3.0:1787790984.014238:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45443c0 x1874634268146176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790984.014247:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268146176:0@lo:400:kworker.0 00000100:00100000:3.0:1787790984.014261:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268146688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790984.014363:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268145408:0@lo:400:kworker.0 00010000:00080000:0.0:1787790984.014374:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d4b40 x1874634268145920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790984.014387:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268145920:0@lo:400:kworker.0 00010000:00080000:0.0:1787790984.014400:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4545a40 x1874634268146432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790984.014408:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268146432:0@lo:400:kworker.0 00000100:00100000:0.0:1787790984.014418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268145024:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787790984.014426:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d43c0 x1874634268145536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790984.014433:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268145536:0@lo:400:kworker.0 00010000:00080000:0.0:1787790984.014441:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc4546d00 x1874634268146048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790984.014450:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268146048:0@lo:400:kworker.0 00000100:00100000:0.0:1787790984.014459:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268146560:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787790984.017842:0:19455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1787790984.459088:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787790984.765929:0:19914:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787790984.766409:0:19914:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787790985.105354:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790985.105620:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241536 00000100:00100000:1.0:1787790985.105630:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241536 00000100:00100000:1.0:1787790985.105745:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:1.0:1787790985.105755:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1874634250241536:12345-192.168.202.22@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787790985.105784:0:17127:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 915f61f1-8646-45de-ac4c-9339109974cf@192.168.202.22@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:2.0:1787790985.106411:0:17127:0:(genops.c:1385:class_connect()) connect: client 915f61f1-8646-45de-ac4c-9339109974cf, cookie 0xcf9477fddcf1eff9 00000100:00080000:2.0:1787790985.106566:0:17127:0:(import.c:65:import_set_state_nolock()) ffff916fc36b0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790985.106639:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+5:2399:x1874634250241536:12345-192.168.202.22@tcp:250:mount.lustre.0 Request processed in 884us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.106648:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:2.0:1787790985.118436:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.118628:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241664 00000100:00100000:3.0:1787790985.118640:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241664 00000100:00100000:3.0:1787790985.118739:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:3.0:1787790985.118752:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+5:14889:x1874634250241664:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787790985.118768:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790985.118787:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4538200/0xcf9477fddcf1f000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f5d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790985.118818:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4538200/0xcf9477fddcf1f000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f5d expref: 6 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790985.118841:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4538200/0xcf9477fddcf1f000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f5d expref: 6 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790985.118851:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538200, rc 0) 00000100:00100000:3.0:1787790985.118928:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+6:14889:x1874634250241664:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 177us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.118935:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:1.0:1787790985.130421:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.130605:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241792 00000100:00100000:2.0:1787790985.130615:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241792 00000100:00100000:2.0:1787790985.130674:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:2.0:1787790985.130684:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+6:14889:x1874634250241792:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787790985.131048:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+6:14889:x1874634250241792:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 362us (635us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787790985.131057:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:1.0:1787790985.137832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.138528:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250241920 00000100:00100000:2.0:1787790985.138552:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250241920 00000100:00100000:2.0:1787790985.138610:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:2.0:1787790985.138621:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+6:14889:x1874634250241920:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790985.138639:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790985.138658:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f64 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.138687:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f64 expref: 7 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.138699:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f64 expref: 7 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.138745:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3e00, rc 0) 00000100:00100000:2.0:1787790985.138813:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+7:14889:x1874634250241920:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 194us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.138820:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:1.0:1787790985.140992:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.141075:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242048 00000100:00100000:3.0:1787790985.141083:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242048 00000100:00100000:3.0:1787790985.141145:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:3.0:1787790985.141156:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+7:14889:x1874634250242048:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787790985.141328:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+8:14889:x1874634250242048:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 173us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.141337:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:1.0:1787790985.151086:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.151158:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242176 00000100:00100000:3.0:1787790985.151167:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242176 00000100:00100000:3.0:1787790985.151225:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:3.0:1787790985.151235:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+8:14889:x1874634250242176:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787790985.151368:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+8:14889:x1874634250242176:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.151382:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:1.0:1787790985.156316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.156622:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242304 00000100:00100000:2.0:1787790985.156632:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242304 00000100:00100000:2.0:1787790985.156689:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:2.0:1787790985.156700:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+8:14907:x1874634250242304:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790985.157030:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+8:14907:x1874634250242304:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 331us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.157038:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:1.0:1787790985.200496:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790985.200665:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242432 00000100:00100000:0.0:1787790985.200674:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242432 00000100:00100000:0.0:1787790985.200763:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:0.0:1787790985.200773:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+8:14907:x1874634250242432:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790985.200941:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+8:14907:x1874634250242432:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 168us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790985.200949:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:1.0:1787790985.207497:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.212128:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242560 00000100:00100000:2.0:1787790985.212142:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242560 00000100:00100000:2.0:1787790985.212202:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:2.0:1787790985.212221:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+8:14907:x1874634250242560:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790985.212393:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+8:14907:x1874634250242560:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 182us (4906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.212402:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:1.0:1787790985.220053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.220230:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242688 00000100:00100000:3.0:1787790985.220240:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242688 00000100:00100000:3.0:1787790985.220300:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:3.0:1787790985.220310:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+8:14889:x1874634250242688:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787790985.220326:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790985.220344:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539c00/0xcf9477fddcf1f00e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f95 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790985.220383:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539c00/0xcf9477fddcf1f00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f95 expref: 9 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790985.220396:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539c00/0xcf9477fddcf1f00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f95 expref: 9 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790985.220405:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539c00, rc 0) 00000100:00100000:3.0:1787790985.220482:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+9:14889:x1874634250242688:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 173us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.220490:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:1.0:1787790985.223818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790985.224030:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242816 00000100:00100000:0.0:1787790985.224040:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242816 00000100:00100000:0.0:1787790985.224107:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:0.0:1787790985.224118:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+9:14889:x1874634250242816:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787790985.224146:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787790985.224164:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787790985.224169:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787790985.224172:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787790985.224175:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787790985.224177:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787790985.227080:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+9:14889:x1874634250242816:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 2955us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790985.227094:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:1.0:1787790985.232511:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.232682:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250242944 00000100:00100000:2.0:1787790985.232692:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250242944 00000100:00100000:2.0:1787790985.232788:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:2.0:1787790985.232799:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+9:14889:x1874634250242944:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790985.232818:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790985.232855:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223f9c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.232998:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 10 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.233012:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 10 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.233021:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2800, rc 0) 00000100:00100000:2.0:1787790985.233083:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+10:14889:x1874634250242944:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 285us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.233090:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:1.0:1787790985.235971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790985.236121:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243072 00000100:00100000:0.0:1787790985.236131:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243072 00000100:00100000:0.0:1787790985.236194:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:0.0:1787790985.236205:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+10:14889:x1874634250243072:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787790985.236364:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+10:14889:x1874634250243072:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 161us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790985.236381:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:1.0:1787790985.241342:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.241499:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243200 00000100:00100000:2.0:1787790985.241509:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243200 00000100:00100000:2.0:1787790985.241568:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:2.0:1787790985.241579:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+10:14889:x1874634250243200:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787790985.241747:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+10:14889:x1874634250243200:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 169us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.241760:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:1.0:1787790985.245444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.246009:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243328 00000100:00100000:3.0:1787790985.246019:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243328 00000100:00100000:3.0:1787790985.246088:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:3.0:1787790985.246098:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+10:14913:x1874634250243328:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790985.246270:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+10:14913:x1874634250243328:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 172us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.246278:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:1.0:1787790985.251802:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790985.251907:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243456 00000100:00100000:0.0:1787790985.251918:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243456 00000100:00100000:0.0:1787790985.251980:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:0.0:1787790985.251990:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+10:14913:x1874634250243456:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790985.252165:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+10:14913:x1874634250243456:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 176us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790985.252173:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:1.0:1787790985.279479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790985.279580:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.279866:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243584 00000100:00100000:3.0:1787790985.279877:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243584 00000100:00100000:3.0:1787790985.279934:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243840 00000100:00100000:3.0:1787790985.279938:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243840 00000100:00100000:3.0:1787790985.279966:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:3.0:1787790985.279975:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874634250243584:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787790985.280005:0:17134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32@192.168.202.22@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1787790985.280172:0:17134:0:(genops.c:1385:class_connect()) connect: client 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32, cookie 0xcf9477fddcf1f01c 00000004:00100000:3.0:1787790985.280198:0:17134:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787790985.280436:0:17134:0:(import.c:65:import_set_state_nolock()) ffff916fc46ed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790985.280499:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2399:x1874634250243584:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 523us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.280507:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:3.0:1787790985.280528:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:3.0:1787790985.280545:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874634250243840:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787790985.280561:0:17134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32@192.168.202.22@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1787790985.280603:0:17134:0:(genops.c:1385:class_connect()) connect: client 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32, cookie 0xcf9477fddcf1f023 00000004:00100000:3.0:1787790985.280615:0:17134:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787790985.280779:0:17134:0:(import.c:65:import_set_state_nolock()) ffff916fc46eb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790985.280804:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2399:x1874634250243840:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 269us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.280811:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787790985.285473:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.285621:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244096 00000100:00100000:3.0:1787790985.285632:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244096 00000100:00100000:3.0:1787790985.285741:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787790985.285751:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14889:x1874634250244096:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787790985.285788:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790985.285865:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14889:x1874634250244096:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 116us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.285873:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00080000:0.0:1787790985.285956:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790985.289833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790985.289874:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790985.289973:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.290250:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244224 00000100:00100000:2.0:1787790985.290259:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244224 00000100:00100000:2.0:1787790985.290310:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243968 00000100:00100000:2.0:1787790985.290313:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243968 00000100:00100000:2.0:1787790985.290332:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250243712 00000100:00100000:2.0:1787790985.290334:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250243712 00000100:00100000:2.0:1787790985.290348:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:2.0:1787790985.290355:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:14889:x1874634250244224:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787790985.290443:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:14889:x1874634250244224:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 88us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.290452:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:2.0:1787790985.290472:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:2.0:1787790985.290478:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:0:x1874634250243968:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787790985.290501:0:17136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790985.290560:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:0:x1874634250243968:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 81us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.290566:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:2.0:1787790985.290578:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:2.0:1787790985.290585:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:0:x1874634250243712:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787790985.290595:0:17136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787790985.290623:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:0:x1874634250243712:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 39us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.290629:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00080000:0.0:1787790985.291167:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790985.293565:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790985.293607:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.293686:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244352 00000100:00100000:3.0:1787790985.293695:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244352 00000100:00100000:3.0:1787790985.293764:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244480 00000100:00100000:3.0:1787790985.293767:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244480 00000100:00100000:3.0:1787790985.293784:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790985.293792:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1874634250244352:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787790985.293826:0:18640:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32@192.168.202.22@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1787790985.293858:0:18640:0:(genops.c:1385:class_connect()) connect: client 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32, cookie 0xcf9477fddcf1f02a 00002000:00100000:3.0:1787790985.293869:0:18640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32/ffff916fc46e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790985.293886:0:18640:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790985.294073:0:18640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787790985.294114:0:18640:0:(import.c:65:import_set_state_nolock()) ffff916fc46ec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790985.294172:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2399:x1874634250244352:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 379us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.294180:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790985.294195:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787790985.294199:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1874634250244480:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787790985.294227:0:18640:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32@192.168.202.22@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1787790985.294244:0:18640:0:(genops.c:1385:class_connect()) connect: client 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32, cookie 0xcf9477fddcf1f031 00002000:00100000:3.0:1787790985.294249:0:18640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32/ffff916fc46eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787790985.294262:0:18640:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787790985.294405:0:18640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787790985.294421:0:18640:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787790985.294443:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2399:x1874634250244480:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 242us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.294450:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:2.0:1787790985.296691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790985.296789:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244608 00000100:00100000:1.0:1787790985.296810:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244608 00000100:00100000:1.0:1787790985.296869:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:1.0:1787790985.296878:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14889:x1874634250244608:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787790985.296968:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14889:x1874634250244608:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790985.296977:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:1.0:1787790985.300979:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790985.301119:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244736 00000100:00100000:3.0:1787790985.301130:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244736 00000100:00100000:3.0:1787790985.301195:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:3.0:1787790985.301206:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14889:x1874634250244736:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787790985.313664:0:17137:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12177us 00000004:00200000:3.0:1787790985.329342:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787790985.329468:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14889:x1874634250244736:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 28258us (28494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790985.329479:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00010000:00010000:1.0:1787790985.490528:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790985.512007:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790985.512119:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244864 00000100:00100000:2.0:1787790985.512130:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244864 00000100:00100000:2.0:1787790985.512200:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:2.0:1787790985.512218:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14936:x1874634250244864:12345-192.168.202.22@tcp:101:mkdir.0 00010000:00010000:2.0:1787790985.512238:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790985.512288:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2200/0xcf9477fddcf1f038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927223fcd expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.512355:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3200/0xcf9477fddcf1f03f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.512371:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3200/0xcf9477fddcf1f03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.512385:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3200/0xcf9477fddcf1f03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790985.512434:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790985.512438:0:17136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790985.512475:0:17136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3200/0xcf9477fddcf1f03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.512502:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2200/0xcf9477fddcf1f038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223fcd expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.512521:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3200/0xcf9477fddcf1f03f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223fcd expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790985.512550:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:2.0:1787790985.512553:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790985.512557:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3200, rc 0) 00000100:00100000:2.0:1787790985.512622:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:14936:x1874634250244864:12345-192.168.202.22@tcp:101:mkdir.0 Request processed in 413us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790985.512628:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000040:00080000:3.0:1787790985.932263:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790986.509152:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787790987.532176:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787790987.646461:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790987.646578:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250244992 00000100:00100000:3.0:1787790987.646611:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250244992 00000100:00080000:0.0:1787790987.646752:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790987.646773:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:3.0:1787790987.646789:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:14988:x1874634250244992:12345-192.168.202.22@tcp:41:lfs.0 00000004:00000024:3.0:1787790987.646839:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790987.646973:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:14988:x1874634250244992:12345-192.168.202.22@tcp:41:lfs.0 Request processed in 187us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790987.646981:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:3.0:1787790987.655468:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790987.659851:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245120 00000100:00100000:2.0:1787790987.659874:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245120 00000100:00100000:2.0:1787790987.660115:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:2.0:1787790987.660145:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14988:x1874634250245120:12345-192.168.202.22@tcp:41:lfs.0 00000004:00000024:2.0:1787790987.660205:0:17136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790987.660347:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14988:x1874634250245120:12345-192.168.202.22@tcp:41:lfs.0 Request processed in 206us (4893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790987.660356:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00080000:0.0:1787790987.662001:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787790987.671049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790987.671273:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245248 00000100:00100000:1.0:1787790987.671286:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245248 00000100:00100000:1.0:1787790987.671385:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:1.0:1787790987.671401:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14988:x1874634250245248:12345-192.168.202.22@tcp:13:lfs.0 00002000:00000024:1.0:1787790987.671447:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787790987.671575:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14988:x1874634250245248:12345-192.168.202.22@tcp:13:lfs.0 Request processed in 179us (541us total) trans 0 rc 0/0 00000100:00080000:0.0:1787790987.671733:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787790987.671850:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787790987.682348:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790987.682540:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245376 00000100:00100000:1.0:1787790987.682554:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245376 00000100:00100000:1.0:1787790987.682789:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787790987.682803:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14988:x1874634250245376:12345-192.168.202.22@tcp:13:lfs.0 00002000:00000024:1.0:1787790987.682852:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787790987.683021:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:14988:x1874634250245376:12345-192.168.202.22@tcp:13:lfs.0 Request processed in 221us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790987.683030:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00080000:0.0:1787790987.692693:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790987.947314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790987.947427:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245504 00000100:00100000:2.0:1787790987.947436:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245504 00000100:00100000:2.0:1787790987.947501:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 131 00000100:00100000:2.0:1787790987.947512:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+10:15019:x1874634250245504:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790987.947932:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790987.947948:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2200/0xcf9477fddcf1f046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927223fd4 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790987.947971:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2200/0xcf9477fddcf1f046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223fd4 expref: 11 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790987.947995:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2200/0xcf9477fddcf1f046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223fd4 expref: 11 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790987.948002:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2200, rc 0) 00000100:00100000:2.0:1787790987.948330:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+11:15019:x1874634250245504:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 818us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790987.948338:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 131 00000100:00100000:3.0:1787790987.952039:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790987.953006:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245632 00000100:00100000:1.0:1787790987.953051:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245632 00000100:00100000:1.0:1787790987.953160:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:1.0:1787790987.953176:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+11:15019:x1874634250245632:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787790987.953666:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+11:15019:x1874634250245632:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 493us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790987.953676:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:3.0:1787790987.969867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790987.970146:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245760 00000100:00100000:2.0:1787790987.970156:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245760 00000100:00100000:2.0:1787790987.970221:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:2.0:1787790987.970232:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+11:15019:x1874634250245760:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787790987.970387:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+11:15019:x1874634250245760:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 157us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790987.970395:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:1.0:1787790987.977345:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790987.977838:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250245888 00000100:00100000:0.0:1787790987.977857:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250245888 00000100:00100000:0.0:1787790987.977965:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:0.0:1787790987.977982:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+11:15027:x1874634250245888:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787790987.978264:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+11:15027:x1874634250245888:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 287us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790987.978274:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:3.0:1787790988.017322:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790988.017479:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246016 00000100:00100000:1.0:1787790988.017489:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246016 00000100:00100000:1.0:1787790988.017552:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:1.0:1787790988.017578:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+11:15027:x1874634250246016:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790988.017771:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+11:15027:x1874634250246016:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 210us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790988.017780:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:2.0:1787790988.026235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790988.026400:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246144 00000100:00100000:1.0:1787790988.026409:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246144 00000100:00100000:1.0:1787790988.026474:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:1.0:1787790988.026485:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc347d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+11:15027:x1874634250246144:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787790988.026891:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc347d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+11:15027:x1874634250246144:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 405us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790988.026899:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:3.0:1787790988.034904:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790988.035212:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246272 00000100:00100000:0.0:1787790988.035222:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246272 00000100:00100000:0.0:1787790988.035288:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787790988.035299:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+11:15019:x1874634250246272:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787790988.035316:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790988.035334:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f04d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927224005 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790988.035363:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224005 expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790988.035374:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224005 expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790988.035384:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165e800, rc 0) 00000100:00100000:0.0:1787790988.035462:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+12:15019:x1874634250246272:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 165us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790988.035470:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787790988.041633:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790988.043241:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246400 00000100:00100000:3.0:1787790988.043257:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246400 00000100:00100000:3.0:1787790988.043328:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:3.0:1787790988.043338:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+12:15019:x1874634250246400:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787790988.043363:0:17129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787790988.043390:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787790988.043394:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787790988.043397:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787790988.043400:0:17129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787790988.043402:0:17129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787790988.046514:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+12:15019:x1874634250246400:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 3167us (4883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.046529:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:1.0:1787790988.052037:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.052189:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246528 00000100:00100000:2.0:1787790988.052200:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246528 00000100:00100000:2.0:1787790988.052257:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:2.0:1787790988.052266:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+12:15019:x1874634250246528:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787790988.052280:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790988.052295:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d92722400c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790988.052320:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 13 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790988.052351:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 13 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790988.052360:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2600, rc 0) 00000100:00100000:2.0:1787790988.052419:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:15019:x1874634250246528:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 153us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.052426:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:0.0:1787790988.058402:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790988.059024:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246656 00000100:00100000:3.0:1787790988.059040:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246656 00000100:00100000:3.0:1787790988.059129:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:3.0:1787790988.059142:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:15019:x1874634250246656:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787790988.059964:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:15019:x1874634250246656:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 810us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.059978:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:3.0:1787790988.069932:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790988.070170:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246784 00000100:00100000:0.0:1787790988.070185:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246784 00000100:00100000:0.0:1787790988.070268:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:0.0:1787790988.070281:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+13:15019:x1874634250246784:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787790988.070493:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+13:15019:x1874634250246784:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 212us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790988.070502:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:0.0:1787790988.081143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790988.081477:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250246912 00000100:00100000:3.0:1787790988.081504:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250246912 00000100:00100000:3.0:1787790988.081597:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:3.0:1787790988.081610:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:15031:x1874634250246912:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787790988.081900:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:15031:x1874634250246912:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 291us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.081909:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:1.0:1787790988.089446:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.091457:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247040 00000100:00100000:2.0:1787790988.091477:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247040 00000100:00100000:2.0:1787790988.091659:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:2.0:1787790988.091676:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:15031:x1874634250247040:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787790988.091971:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:15031:x1874634250247040:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 299us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.091981:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:1.0:1787790988.107184:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790988.107218:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268146816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790988.107349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790988.107921:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146816 00000100:00100000:0.0:1787790988.107935:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146816 00000100:00100000:0.0:1787790988.108029:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790988.108044:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268146816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790988.108078:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787790988.108163:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268146816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790988.108171:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787790988.108288:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790988.108384:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268146816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787790988.120522:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.120572:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.120614:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.120659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.120681:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.120750:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.120789:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247168 00000100:00100000:2.0:1787790988.120802:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247168 00000100:00100000:2.0:1787790988.120842:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247424 00000100:00100000:2.0:1787790988.120845:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247424 00000100:00100000:2.0:1787790988.120854:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247808 00000100:00100000:2.0:1787790988.120886:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247808 00000100:00100000:2.0:1787790988.120926:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247936 00000100:00100000:2.0:1787790988.120929:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247936 00000100:00100000:2.0:1787790988.120948:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:2.0:1787790988.120960:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2402:x1874634250247808:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790988.121227:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:1.0:1787790988.121238:0:17135:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787790988.121243:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250247936:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790988.121253:0:17135:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787790988.121320:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250247936:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 83us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790988.121330:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:0.0:1787790988.121366:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787790988.121372:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1874634250247168:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787790988.121405:0:18527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3648b1be-585a-40cf-a928-57e0e7a37168@192.168.202.22@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1787790988.121457:0:18527:0:(genops.c:1385:class_connect()) connect: client 3648b1be-585a-40cf-a928-57e0e7a37168, cookie 0xcf9477fddcf1f05b 00000004:00100000:0.0:1787790988.121498:0:18527:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787790988.121613:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787790988.121622:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874634250247424:12345-192.168.202.22@tcp:38:mount.lustre.0 00000100:00080000:0.0:1787790988.121643:0:18527:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd7800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787790988.121654:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3648b1be-585a-40cf-a928-57e0e7a37168@192.168.202.22@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1787790988.121689:0:17135:0:(genops.c:1385:class_connect()) connect: client 3648b1be-585a-40cf-a928-57e0e7a37168, cookie 0xcf9477fddcf1f062 00000100:00100000:0.0:1787790988.121698:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2399:x1874634250247168:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 323us (1201us total) trans 0 rc 0/0 00000004:00100000:1.0:1787790988.121734:0:17135:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787790988.121744:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00080000:1.0:1787790988.121803:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9170f3de0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787790988.121855:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:2399:x1874634250247424:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 234us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790988.121863:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:2.0:1787790988.122267:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2402:x1874634250247808:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 1306us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.122276:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:3.0:1787790988.122527:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248064 00000100:00100000:3.0:1787790988.122537:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248064 00000100:00100000:3.0:1787790988.122642:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248192 00000100:00100000:3.0:1787790988.122645:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248192 00000100:00100000:0.0:1787790988.122669:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787790988.122680:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:0.0:1787790988.122685:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250248064:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790988.122695:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250248192:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790988.122864:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250248064:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 184us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790988.122872:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787790988.129443:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250248192:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 6735us (8675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.129460:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:0.0:1787790988.132615:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790988.132664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790988.132726:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790988.132896:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247296 00000100:00100000:2.0:1787790988.132910:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247296 00000100:00100000:3.0:1787790988.133005:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247552 00000100:00100000:2.0:1787790988.133005:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250247680 00000100:00100000:2.0:1787790988.133010:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247680 00000100:00100000:3.0:1787790988.133013:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250247552 00000100:00100000:2.0:1787790988.133042:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00080000:0.0:1787790988.133084:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790988.133089:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790988.133129:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+7:0:x1874634250247296:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787790988.133198:0:17135:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790988.133263:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787790988.133274:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3648b1be-585a-40cf-a928-57e0e7a37168+7:15019:x1874634250247680:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787790988.133290:0:19928:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787790988.133297:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+7:0:x1874634250247296:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 169us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.133307:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787790988.133326:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250247680:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 52us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.133333:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:2.0:1787790988.133655:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:0:x1874634250247552:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787790988.133678:0:17135:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790988.133749:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:0:x1874634250247552:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 408us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.135399:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:2.0:1787790988.138233:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:0.0:1787790988.141678:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790988.141978:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248320 00000100:00100000:1.0:1787790988.141992:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248320 00000100:00100000:1.0:1787790988.142072:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:1.0:1787790988.142085:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250248320:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787790988.142220:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250248320:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 136us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790988.142230:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787790988.145638:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790988.145695:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790988.145907:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790988.146207:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248704 00000100:00100000:1.0:1787790988.146221:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248704 00000100:00100000:1.0:1787790988.146309:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:1.0:1787790988.146323:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250248704:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787790988.146434:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250248704:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 114us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790988.146465:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:0.0:1787790988.149562:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790988.150163:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248832 00000100:00100000:3.0:1787790988.150180:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248832 00000100:00100000:3.0:1787790988.150255:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:3.0:1787790988.150269:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250248832:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787790988.150398:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787790988.150519:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:15019:x1874634250248832:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 252us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.150527:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787790988.152334:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248448 00000100:00100000:2.0:1787790988.152353:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248448 00000100:00100000:2.0:1787790988.152447:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248576 00000100:00100000:2.0:1787790988.152451:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248576 00000100:00100000:2.0:1787790988.152485:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787790988.152495:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874634250248448:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787790988.152544:0:19281:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3648b1be-585a-40cf-a928-57e0e7a37168@192.168.202.22@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1787790988.152782:0:19281:0:(genops.c:1385:class_connect()) connect: client 3648b1be-585a-40cf-a928-57e0e7a37168, cookie 0xcf9477fddcf1f069 00002000:00100000:2.0:1787790988.152799:0:19281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3648b1be-585a-40cf-a928-57e0e7a37168/ffff9170c3536000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787790988.152814:0:19281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787790988.152935:0:19281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787790988.152980:0:19281:0:(import.c:65:import_set_state_nolock()) ffff9170c3530000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790988.153070:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2399:x1874634250248448:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 576us (7375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.153080:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787790988.153102:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:2.0:1787790988.153107:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874634250248576:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787790988.153125:0:19281:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3648b1be-585a-40cf-a928-57e0e7a37168@192.168.202.22@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1787790988.154050:0:19281:0:(genops.c:1385:class_connect()) connect: client 3648b1be-585a-40cf-a928-57e0e7a37168, cookie 0xcf9477fddcf1f070 00002000:00100000:2.0:1787790988.154067:0:19281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3648b1be-585a-40cf-a928-57e0e7a37168/ffff9170c3533800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787790988.154078:0:19281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787790988.154508:0:19281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787790988.155096:0:19281:0:(import.c:65:import_set_state_nolock()) ffff9170f39e1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787790988.155259:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2399:x1874634250248576:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 2146us (9347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790988.155272:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:0.0:1787790988.373041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790988.373159:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250248960 00000100:00100000:3.0:1787790988.373173:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250248960 00000100:00100000:3.0:1787790988.373259:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:3.0:1787790988.373272:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+6:15054:x1874634250248960:12345-192.168.202.22@tcp:101:mkdir.0 00010000:00010000:3.0:1787790988.373300:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790988.373331:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1f077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722403d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790988.373569:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790988.373616:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790988.373635:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790988.373692:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787790988.373696:0:17136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787790988.373755:0:17136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790988.373789:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538c00/0xcf9477fddcf1f077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790988.373812:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790988.373823:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:3.0:1787790988.373827:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787790988.373830:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539800, rc 0) 00000100:00100000:3.0:1787790988.373924:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+7:15054:x1874634250248960:12345-192.168.202.22@tcp:101:mkdir.0 Request processed in 653us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.373932:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00010000:00010000:1.0:1787790988.556635:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790988.619081:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790988.619130:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268146944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790988.619234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790988.619779:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790988.619794:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268147072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790988.619838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790988.619901:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268146944 00000100:00100000:3.0:1787790988.619912:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268146944 00000100:00100000:3.0:1787790988.619977:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147072 00000100:00100000:3.0:1787790988.619981:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147072 00000100:00100000:3.0:1787790988.619999:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790988.620008:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268146944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787790988.620044:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787790988.620088:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268146944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.620096:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787790988.620115:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787790988.620122:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268147072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787790988.620133:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787790988.620511:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268147072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 387us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790988.620520:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790988.623522:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268146944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790988.627945:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268147072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790989.131199:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268147200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790989.131310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.131376:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790989.131383:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268147328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790989.131409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.131456:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147200 00000100:00100000:3.0:1787790989.131465:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147200 00000100:00100000:3.0:1787790989.131551:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147328 00000100:00100000:3.0:1787790989.131555:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147328 00000100:00100000:3.0:1787790989.131587:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790989.131598:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268147200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790989.131635:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787790989.131690:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268147200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.131747:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787790989.131767:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787790989.131773:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268147328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790989.131791:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787790989.131821:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268147328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.131827:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787790989.131846:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790989.131850:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787790989.131902:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268147328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790989.131918:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268147200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790989.132277:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268147584:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790989.132362:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268148096:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790989.132409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268148608:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790989.132458:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787790989.132463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268147456:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790989.132529:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268147968:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790989.132569:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268148480:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790989.132621:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148096 00000100:00100000:0.0:1787790989.132626:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148096 00000100:00100000:0.0:1787790989.132664:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790989.132672:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268148096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132738:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268148096:12345-0@lo:400:kworker.0 Request processed in 66us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790989.132746:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787790989.132769:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148608 00000100:00100000:0.0:1787790989.132772:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148608 00000100:00100000:0.0:1787790989.132818:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148480 00000100:00100000:0.0:1787790989.132821:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148480 00000100:00100000:0.0:1787790989.132842:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787790989.132848:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268148608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132890:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874634268148608:12345-0@lo:400:kworker.0 Request processed in 43us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790989.132897:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787790989.132909:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790989.132915:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.132941:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268148480:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790989.132947:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787790989.132967:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147456 00000100:00100000:0.0:1787790989.132970:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147456 00000100:00100000:0.0:1787790989.132999:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787790989.133005:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3641:x1874634268147456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133036:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3641:x1874634268147456:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790989.133042:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787790989.133072:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147584 00000100:00100000:0.0:1787790989.133076:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147584 00000100:00100000:0.0:1787790989.133102:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147968 00000100:00100000:0.0:1787790989.133106:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147968 00000100:00100000:0.0:1787790989.133119:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787790989.133126:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268147584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133160:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268147584:12345-0@lo:400:kworker.0 Request processed in 35us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790989.133176:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787790989.133187:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787790989.133193:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268147968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133222:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268147968:12345-0@lo:400:kworker.0 Request processed in 29us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790989.133227:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787790989.133280:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268147456:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133293:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268147968:0@lo:400:kworker.0 00010000:00080000:0.0:1787790989.133306:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a543c0 x1874634268148480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790989.133316:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268148480:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133325:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268147584:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133336:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268148096:0@lo:400:kworker.0 00000100:00100000:0.0:1787790989.133348:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874634268148608:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.133778:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268147840:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.133827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.133874:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268148352:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.133899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.133927:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787790989.133934:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268147712:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.133958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.133983:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268148224:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.134030:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268148736:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790989.134088:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147712 00000100:00100000:3.0:1787790989.134094:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147712 00000100:00100000:3.0:1787790989.134152:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790989.134160:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268147712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134203:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268147712:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.134209:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790989.134233:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268147840 00000100:00100000:3.0:1787790989.134236:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268147840 00000100:00100000:3.0:1787790989.134259:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148352 00000100:00100000:3.0:1787790989.134262:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148352 00000100:00100000:3.0:1787790989.134276:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148224 00000100:00100000:3.0:1787790989.134278:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148224 00000100:00100000:3.0:1787790989.134288:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148736 00000100:00100000:3.0:1787790989.134290:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148736 00000100:00100000:3.0:1787790989.134305:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790989.134312:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268147840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134345:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268147840:12345-0@lo:400:kworker.0 Request processed in 34us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.134350:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787790989.134361:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790989.134366:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268148352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134415:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268148352:12345-0@lo:400:kworker.0 Request processed in 49us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.134421:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787790989.134434:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790989.134440:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268148224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134465:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268148224:12345-0@lo:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.134481:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787790989.134492:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787790989.134497:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268148736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134525:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268148736:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790989.134531:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787790989.134553:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787790989.134558:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787790989.134560:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790989.134584:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787790989.134606:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268147712:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134619:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268148224:0@lo:400:kworker.0 00010000:00080000:3.0:1787790989.134631:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a54780 x1874634268148736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787790989.134641:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268148736:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134652:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268147840:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.134662:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268148352:0@lo:400:kworker.0 00000100:00100000:3.0:1787790989.135390:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787790989.135409:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268148864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790989.135466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790989.138900:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148864 00000100:00100000:1.0:1787790989.138925:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148864 00000100:00100000:1.0:1787790989.139891:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790989.139910:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268148864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787790989.139950:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787790989.140097:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268148864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790989.140106:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787790989.140997:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268148864:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787790989.517000:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790989.579043:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790990.604301:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787790991.184926:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:0.0:1787790991.184944:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:00100000:3.0:1787790991.185437:0:17867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:3.0:1787790991.185450:0:17867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:00100000:2.0:1787790991.188544:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:2.0:1787790991.188568:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:00100000:3.0:1787790991.188694:0:17114:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:3.0:1787790991.188736:0:17114:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:02000400:0.0:1787790991.346405:0:20013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787790991.627356:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790992.652687:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790993.228165:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787790993.229413:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268148992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787790993.229493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790993.230195:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268148992 00000100:00100000:3.0:1787790993.230204:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268148992 00000100:00100000:3.0:1787790993.230464:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787790993.230474:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268148992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787790993.230507:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787790993.230564:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268148992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790993.230571:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787790993.230612:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790993.230649:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268148992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790993.357137:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790993.357178:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790993.357199:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790993.357216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790993.357233:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790993.357309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790993.357344:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249216 00000100:00100000:1.0:1787790993.357353:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249216 00000100:00100000:1.0:1787790993.357405:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249344 00000100:00100000:1.0:1787790993.357407:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249344 00000100:00100000:1.0:1787790993.357421:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249856 00000100:00100000:1.0:1787790993.357431:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249856 00000100:00100000:1.0:1787790993.357448:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:1.0:1787790993.357456:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2400:x1874634250249216:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790993.357520:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2400:x1874634250249216:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790993.357527:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:1.0:1787790993.357543:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:1.0:1787790993.357548:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250249344:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790993.357566:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250249344:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 18us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790993.357571:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:1.0:1787790993.357579:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:1.0:1787790993.357585:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250249856:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790993.357600:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250249856:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 16us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790993.357606:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:1.0:1787790993.357624:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249600 00000100:00100000:1.0:1787790993.357626:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249600 00000100:00100000:1.0:1787790993.357647:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250112 00000100:00100000:1.0:1787790993.357649:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250112 00000100:00100000:1.0:1787790993.357664:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787790993.357670:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250249600:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790993.357689:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250249600:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 19us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790993.357695:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787790993.357733:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787790993.357740:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250250112:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790993.357761:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250250112:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790993.357767:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00080000:1.0:1787790993.357787:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787790993.357791:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787790993.357793:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787790993.358667:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249088 00000100:00100000:2.0:1787790993.358676:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249088 00000100:00100000:2.0:1787790993.358748:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 145 00000100:00100000:2.0:1787790993.358755:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250249088:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790993.358808:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250249088:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 54us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790993.358816:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 145 00000100:00100000:3.0:1787790993.374809:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790993.374863:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790993.374910:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790993.375098:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249728 00000100:00100000:0.0:1787790993.375109:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249728 00000100:00100000:0.0:1787790993.375177:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:0.0:1787790993.375188:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2400:x1874634250249728:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787790993.375264:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2400:x1874634250249728:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790993.375271:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00080000:0.0:1787790993.375293:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787790993.378867:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249984 00000100:00100000:2.0:1787790993.378867:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250249472 00000100:00100000:3.0:1787790993.378881:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249984 00000100:00100000:2.0:1787790993.378881:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250249472 00000100:00100000:3.0:1787790993.378968:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:2.0:1787790993.379085:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:3.0:1787790993.379089:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3648b1be-585a-40cf-a928-57e0e7a37168+5:2400:x1874634250249984:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787790993.379100:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2400:x1874634250249472:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790993.379174:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3648b1be-585a-40cf-a928-57e0e7a37168+5:2400:x1874634250249984:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 86us (4261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790993.379175:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2400:x1874634250249472:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 74us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790993.379188:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:2.0:1787790993.379217:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00080000:2.0:1787790993.379411:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787790993.674955:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790993.742176:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268149120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790993.742527:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787790993.742544:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268149248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787790993.743756:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790993.743790:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149120 00000100:00100000:2.0:1787790993.743797:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149120 00000100:00100000:2.0:1787790993.743858:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787790993.743867:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268149120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790993.743897:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790993.743943:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268149120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790993.743967:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787790993.743987:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268149120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787790993.744063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790993.744216:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149248 00000100:00100000:2.0:1787790993.744220:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149248 00000100:00100000:2.0:1787790993.744251:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787790993.744259:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268149248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790993.744278:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787790993.744321:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268149248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790993.744327:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787790993.744383:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268149248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787790994.253479:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268149376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790994.253556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790994.253608:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149376 00000100:00100000:3.0:1787790994.253616:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149376 00000100:00100000:3.0:1787790994.253678:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787790994.253688:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268149376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787790994.253757:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787790994.253803:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268149376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790994.253810:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787790994.253847:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790994.253882:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268149376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787790994.254923:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790994.254963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790994.255004:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149504 00000100:00100000:0.0:1787790994.255009:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149504 00000100:00100000:0.0:1787790994.255045:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787790994.255051:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268149504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790994.255067:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787790994.255107:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268149504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790994.255113:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787790994.255130:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790994.255155:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790994.257922:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268149632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790994.258012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790994.258063:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149632 00000100:00100000:0.0:1787790994.258070:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149632 00000100:00100000:0.0:1787790994.258115:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787790994.258124:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268149632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787790994.258144:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787790994.258186:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268149632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790994.258192:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787790994.258214:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790994.258248:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268149632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787790994.258612:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268149760:0@lo:400:kworker.0 00000100:00100000:0.0:1787790994.258646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.258731:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149760 00000100:00100000:1.0:1787790994.258736:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149760 00000100:00100000:1.0:1787790994.258767:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787790994.258774:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268149760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.259597:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268149760:12345-0@lo:400:kworker.0 Request processed in 820us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.259606:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787790994.259849:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268149760:0@lo:400:kworker.0 00000100:00100000:0.0:1787790994.259866:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787790994.259874:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268149888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790994.259911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.259990:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268149888 00000100:00100000:1.0:1787790994.259995:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268149888 00000100:00100000:1.0:1787790994.260036:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790994.260044:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268149888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.260087:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268149888:12345-0@lo:400:kworker.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.260093:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787790994.260118:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268149888:0@lo:400:kworker.0 00000100:00100000:0.0:1787790994.260338:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268150016:0@lo:400:kworker.0 00000100:00100000:0.0:1787790994.260370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.260484:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150016 00000100:00100000:1.0:1787790994.260489:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150016 00000100:00100000:1.0:1787790994.260519:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787790994.260537:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.260697:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268150016:12345-0@lo:400:kworker.0 Request processed in 159us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.260720:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787790994.260948:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268150400:0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.261037:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268150272:0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.261068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.261088:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268150784:0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.261110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.261140:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150272 00000100:00100000:1.0:1787790994.261144:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150272 00000100:00100000:1.0:1787790994.261171:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790994.261178:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268150272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.261213:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268150272:12345-0@lo:400:kworker.0 Request processed in 35us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.261219:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790994.261236:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150784 00000100:00100000:1.0:1787790994.261239:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150784 00000100:00100000:1.0:1787790994.261268:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787790994.261274:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268150784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.261316:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268150784:12345-0@lo:400:kworker.0 Request processed in 42us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.261322:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787790994.261345:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790994.261365:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268150272:0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.261389:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268150784:0@lo:400:kworker.0 00000100:00100000:3.0:1787790994.261551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790994.261580:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268150912:0@lo:400:kworker.0 00000100:00100000:3.0:1787790994.261601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790994.261628:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268150144:0@lo:400:kworker.0 00000100:00100000:3.0:1787790994.261652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790994.261671:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268150656:0@lo:400:kworker.0 00000100:00100000:3.0:1787790994.261691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790994.261733:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787790994.261739:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268150528:0@lo:400:kworker.0 00000100:00100000:3.0:1787790994.261761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790994.261785:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150144 00000100:00100000:3.0:1787790994.261789:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150144 00000100:00100000:3.0:1787790994.261813:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787790994.261832:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268150144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790994.261870:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268150144:12345-0@lo:400:kworker.0 Request processed in 51us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790994.261885:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787790994.261911:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268150144:0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.262073:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150400 00000100:00100000:1.0:1787790994.262078:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150400 00000100:00100000:1.0:1787790994.262102:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150912 00000100:00100000:1.0:1787790994.262105:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150912 00000100:00100000:1.0:1787790994.262123:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150656 00000100:00100000:1.0:1787790994.262126:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150656 00000100:00100000:1.0:1787790994.262138:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268150528 00000100:00100000:1.0:1787790994.262141:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268150528 00000100:00100000:1.0:1787790994.262155:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790994.262161:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268150400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.262198:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268150400:12345-0@lo:400:kworker.0 Request processed in 37us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.262204:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790994.262216:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790994.262222:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268150912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.262248:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268150912:12345-0@lo:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.262253:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790994.262264:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787790994.262270:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268150656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.262301:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268150656:12345-0@lo:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.262307:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787790994.262318:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787790994.262323:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268150528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.262348:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268150528:12345-0@lo:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.262362:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787790994.262534:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787790994.262537:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787790994.262577:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268150400:0@lo:400:kworker.0 00010000:00080000:1.0:1787790994.262590:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45b1a40 x1874634268150912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790994.262600:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268150912:0@lo:400:kworker.0 00000100:00100000:1.0:1787790994.262622:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268150528:0@lo:400:kworker.0 00010000:00080000:1.0:1787790994.262630:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45b21c0 x1874634268150656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787790994.262638:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268150656:0@lo:400:kworker.0 00000100:00100000:0.0:1787790994.263122:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268150016:0@lo:400:kworker.0 00000020:00000080:2.0:1787790994.549495:0:20161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe05c003e0 20000000:00000080:2.0:1787790994.549515:0:20161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9170fe1fa800 uarg=0000000000000000 20000000:01000000:2.0:1787790994.549572:0:20161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787790994.549578:0:20161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787790994.549583:0:20161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787790994.550551:0:20162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787790994.551016:0:20161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787790994.564546:0:20161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787790994.564582:0:20161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564605:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564614:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564621:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 23 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564628:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564639:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564646:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564654:0:20161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564701:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.564989:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 12 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.565005:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151040:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790994.565102:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.565111:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 12 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.565119:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151168:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790994.565152:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.565160:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 23 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.565169:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151296:0@lo:104: 00000100:00100000:3.0:1787790994.565236:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790994.565286:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 23 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.565294:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 23 pid: 17129 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790994.565468:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268151296 00000100:00100000:2.0:1787790994.565476:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268151296 00000100:00100000:2.0:1787790994.565533:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787790994.565543:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:20161:x1874634268151296:12345-0@lo:104: 00010000:00010000:2.0:1787790994.565556:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790994.565607:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790994.565613:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:20161:x1874634268151296:12345-0@lo:104: Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790994.565620:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787790994.565915:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151424:0@lo:104: 00000100:00100000:3.0:1787790994.565944:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787790994.566185:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790994.566192:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566200:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790994.566204:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566212:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790994.566228:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790994.566234:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787790994.566282:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566288:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790994.566319:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566327:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1edfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ee01 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566339:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.566341:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.566343:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790994.566356:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790994.566368:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268151552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790994.566398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.566434:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268151552 00000100:00100000:1.0:1787790994.566439:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268151552 00010000:00010000:1.0:1787790994.566458:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 24 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790994.566481:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790994.566489:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3641:x1874634268151552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790994.566501:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790994.566507:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 24 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566517:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 24 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.566536:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790994.566572:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3641:x1874634268151552:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.566579:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787790994.566618:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268151552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787790994.566686:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.566696:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 23 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.566730:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151680:0@lo:104: 00000100:00100000:3.0:1787790994.566754:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787790994.573185:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790994.573203:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 23 pid: 17127 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.573231:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151808:0@lo:104: 00000100:00100000:3.0:1787790994.573294:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.573421:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790994.573490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790994.573514:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250240 00000100:00100000:1.0:1787790994.573522:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250240 00010000:00010000:1.0:1787790994.573558:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 13 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790994.573583:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250368 00000100:00100000:1.0:1787790994.573586:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250368 00010000:00010000:1.0:1787790994.573597:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 14 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790994.573612:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787790994.573620:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+14:2402:x1874634250250240:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790994.573633:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790994.573639:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 14 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.573650:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 14 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.573668:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790994.573727:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+14:2402:x1874634250250240:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 107us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.573736:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787790994.573771:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787790994.573777:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+13:2402:x1874634250250368:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790994.573785:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790994.573789:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 13 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.573797:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 13 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.573807:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790994.573838:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+13:2402:x1874634250250368:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 61us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.573844:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:2.0:1787790994.574838:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268151424 00000100:00100000:2.0:1787790994.574857:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268151424 00000100:00100000:2.0:1787790994.574893:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268151680 00000100:00100000:2.0:1787790994.574896:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268151680 00000100:00100000:2.0:1787790994.574912:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790994.574920:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:20161:x1874634268151424:12345-0@lo:104: 00010000:00010000:2.0:1787790994.574934:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790994.576396:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787790994.576409:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+4:20161:x1874634268151424:12345-0@lo:104: Request processed in 1488us (10462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790994.576420:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787790994.576449:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787790994.576459:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:20161:x1874634268151680:12345-0@lo:104: 00010000:00010000:2.0:1787790994.576471:0:17118:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.576656:0:20161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb240 going to sleep for 11 seconds 00010000:00010000:3.0:1787790994.576686:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f054 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722400c expref: 12 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.576718:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151040:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790994.576733:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d2800/0xcf9477fddcf1f015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f9c expref: 11 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.576743:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151168:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790994.576755:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995200/0xcf9477fddcf1ee01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1edfa expref: 23 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790994.576764:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151296:0@lo:104: 00000100:00100000:3.0:1787790994.576794:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151424:0@lo:104: 00000100:00100000:3.0:1787790994.576801:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151680:0@lo:104: 00010000:00010000:1.0:1787790994.580449:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787790994.580468:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580481:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790994.580486:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580497:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790994.580505:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790994.580511:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787790994.580578:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580600:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790994.580634:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580642:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fb000/0xcf9477fddcf1ed60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed67 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580658:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790994.580661:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580667:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790994.580670:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580678:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790994.580684:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790994.580690:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787790994.580726:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580732:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790994.580747:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580753:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5e00/0xcf9477fddcf1ed21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed28 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.580772:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.580774:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.580776:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790994.580794:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268152064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790994.580872:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.580924:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268151936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790994.580953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.581330:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152064 00000100:00100000:1.0:1787790994.581338:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152064 00010000:00010000:1.0:1787790994.581367:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 23 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790994.581389:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268151936 00000100:00100000:1.0:1787790994.581392:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268151936 00010000:00010000:1.0:1787790994.581421:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 24 pid: 17129 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790994.581436:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790994.581444:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268152064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790994.581456:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790994.581462:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 24 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.581471:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 24 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.581487:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad4600/0xcf9477fddcf1ed28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ed21 expref: 24 pid: 17128 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.581512:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790994.581558:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:3638:x1874634268152064:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.581565:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787790994.581583:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790994.581590:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:3641:x1874634268151936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790994.581597:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790994.581601:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 22 pid: 17129 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.581611:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 22 pid: 17129 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.581621:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad4800/0xcf9477fddcf1ed67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ed60 expref: 22 pid: 17129 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.581629:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790994.581656:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3641:x1874634268151936:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.581661:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787790994.581739:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268151936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787790994.581812:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268152064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790994.582131:0:17118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787790994.582140:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:20161:x1874634268151680:12345-0@lo:104: Request processed in 5684us (15384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790994.582148:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787790994.582549:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268151808 00000100:00100000:0.0:1787790994.582555:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268151808 00000100:00100000:0.0:1787790994.582614:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787790994.582621:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:20161:x1874634268151808:12345-0@lo:104: 00010000:00010000:0.0:1787790994.582633:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790994.582729:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787790994.582735:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+3:20161:x1874634268151808:12345-0@lo:104: Request processed in 116us (9443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790994.582742:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787790994.582888:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787790994.582895:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.582902:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787790994.582905:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790994.582913:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1874634268151808:0@lo:104: 00010000:00010000:1.0:1787790994.582919:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787790994.582925:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787790994.582931:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787790994.582944:0:20161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.582959:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.582965:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787790994.582997:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583005:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4538400/0xcf9477fddcf1ed13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1ed1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583019:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.583020:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.583022:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790994.583028:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787790994.583035:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787790994.583046:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268152192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787790994.583083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790994.583119:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152192 00000100:00100000:1.0:1787790994.583122:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152192 00010000:00010000:1.0:1787790994.583616:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 21 pid: 17127 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790994.583735:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787790994.583751:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3638:x1874634268152192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787790994.583761:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790994.583766:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 21 pid: 17127 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583776:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 21 pid: 17127 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583790:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fa200/0xcf9477fddcf1ed1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1ed13 expref: 21 pid: 17127 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583803:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583811:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583836:0:17120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583844:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583851:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583858:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583863:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787790994.583867:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583881:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583896:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.583905:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790994.583937:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:3638:x1874634268152192:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790994.583944:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787790994.584005:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268152192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787790994.584344:0:20161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790994.584352:0:20161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790994.584364:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f085 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790994.699501:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787790995.148738:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787790995.652098:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790995.652475:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250496 00000100:00100000:2.0:1787790995.652485:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250496 00000100:00100000:2.0:1787790995.652540:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:2.0:1787790995.652552:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+11:14904:x1874634250250496:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790995.652568:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790995.652588:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f08c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927224044 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790995.652616:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224044 expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790995.652628:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224044 expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790995.652637:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2e00, rc 0) 00000100:00100000:2.0:1787790995.652728:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+12:14904:x1874634250250496:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 178us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790995.652736:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:1.0:1787790995.661660:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790995.662382:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250624 00000100:00100000:2.0:1787790995.662391:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250624 00000100:00100000:2.0:1787790995.662471:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:2.0:1787790995.662482:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+12:14904:x1874634250250624:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790995.662622:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+12:14904:x1874634250250624:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 142us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790995.662635:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:3.0:1787790995.671266:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790995.671304:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250752 00000100:00100000:3.0:1787790995.671314:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250752 00000100:00100000:3.0:1787790995.671359:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:3.0:1787790995.671368:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+12:14904:x1874634250250752:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790995.671481:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+12:14904:x1874634250250752:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790995.671490:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:3.0:1787790995.683788:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790995.684159:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250250880 00000100:00100000:2.0:1787790995.684169:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250250880 00000100:00100000:2.0:1787790995.684261:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:2.0:1787790995.684273:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+12:14904:x1874634250250880:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790995.684292:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790995.684312:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f093 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d92722404b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790995.684341:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722404b expref: 13 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790995.684366:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722404b expref: 13 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790995.684374:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3a00, rc 0) 00000100:00100000:2.0:1787790995.684439:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:14904:x1874634250250880:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 169us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790995.684446:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:1.0:1787790995.690100:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790995.690175:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251008 00000100:00100000:3.0:1787790995.690184:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251008 00000100:00100000:3.0:1787790995.690228:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:3.0:1787790995.690235:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:14904:x1874634250251008:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790995.690378:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:14904:x1874634250251008:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 143us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790995.690387:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:1.0:1787790995.695895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790995.695970:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251136 00000100:00100000:2.0:1787790995.695982:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251136 00000100:00100000:2.0:1787790995.696047:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 152 00000100:00100000:2.0:1787790995.696058:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:14904:x1874634250251136:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790995.696202:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:14904:x1874634250251136:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790995.696210:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 152 00010000:00010000:1.0:1787790995.723888:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787790996.043875:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790996.043884:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170e02d7800 from 13 10000000:01000000:3.0:1787790996.043889:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790996.043938:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.043950:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.043976:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790996.044001:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.044069:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790996.044102:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790996.044168:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152320 00000100:00100000:1.0:1787790996.044174:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152320 00000100:00100000:1.0:1787790996.044237:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787790996.044256:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:17131:x1874634268152320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787790996.044271:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790996.044285:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f0a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f09a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790996.044307:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f09a expref: 21 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790996.044317:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f09a expref: 21 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790996.044342:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4e00, rc 0) 00000100:00100000:1.0:1787790996.044389:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268152320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790996.044396:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787790996.044690:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790996.044753:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.044762:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790996.044846:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.044877:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790996.044899:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790996.045004:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152448 00000100:00100000:1.0:1787790996.045008:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152448 00000100:00100000:1.0:1787790996.045036:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787790996.045042:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268152448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787790996.045148:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268152448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790996.045155:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787790996.045260:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.045289:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.045327:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790996.045345:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787790996.045357:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152576 00000100:00100000:2.0:1787790996.045361:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152576 00000100:00100000:2.0:1787790996.045382:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787790996.045388:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268152576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.045453:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268152576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790996.045459:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787790996.045510:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787790996.046641:0:20229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787790996.046736:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787790996.047526:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790996.047538:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790996.047549:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787790996.047560:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787790996.047563:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f67ce800 from 13 10000000:01000000:2.0:1787790996.047565:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787790996.047599:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790996.047607:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790996.047628:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790996.047645:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.048001:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790996.048083:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.049537:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152704 00000100:00100000:3.0:1787790996.049549:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152704 00000100:00100000:3.0:1787790996.049644:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787790996.049655:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:17131:x1874634268152704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790996.049680:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790996.049700:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f0af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f0a8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.050104:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f0a8 expref: 22 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.050133:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f0a8 expref: 22 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.050142:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538c00, rc 0) 00000100:00100000:3.0:1787790996.050227:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268152704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 574us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.050234:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787790996.050361:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787790996.050379:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790996.050388:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790996.050467:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.050502:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790996.051013:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.051369:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152832 00000100:00100000:3.0:1787790996.051375:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152832 00000100:00100000:3.0:1787790996.051407:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787790996.051416:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268152832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.051543:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268152832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.051550:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787790996.051641:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.051687:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787790996.051766:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790996.051783:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.051986:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268152960 00000100:00100000:3.0:1787790996.051990:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268152960 00000100:00100000:3.0:1787790996.052009:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787790996.052015:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268152960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.052089:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268152960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.052095:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787790996.052169:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268152960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787790996.055578:0:20230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787790996.056075:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787790996.056103:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787790996.056115:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.056146:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787790996.056156:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787790996.056159:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170ce839000 from 13 10000000:01000000:3.0:1787790996.056161:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787790996.056194:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.056202:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.056212:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790996.056234:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.056583:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790996.056625:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.056960:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153088 00000100:00100000:3.0:1787790996.056967:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153088 00000100:00100000:3.0:1787790996.057005:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790996.057013:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:17131:x1874634268153088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790996.057026:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790996.057039:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f0bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f0b6 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.057062:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f0b6 expref: 23 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.057085:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f0b6 expref: 23 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.057094:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539200, rc 0) 00000100:00100000:3.0:1787790996.057132:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268153088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.057138:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787790996.057179:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790996.057191:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.057200:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790996.057311:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.057336:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790996.057481:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.057494:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153216 00000100:00100000:3.0:1787790996.057497:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153216 00000100:00100000:3.0:1787790996.057513:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790996.057518:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268153216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.057612:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268153216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.057618:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787790996.057653:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.058579:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.058632:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790996.058663:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.058696:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153344 00000100:00100000:3.0:1787790996.058701:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153344 00000100:00100000:3.0:1787790996.058753:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787790996.058762:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268153344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.058872:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268153344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.058879:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787790996.058927:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787790996.062992:0:20231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787790996.063086:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787790996.063114:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787790996.063127:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790996.063139:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787790996.063151:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787790996.063154:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff916fc46e5000 from 13 10000000:01000000:0.0:1787790996.063157:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787790996.063203:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790996.063211:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790996.063222:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790996.063247:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787790996.063315:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790996.063374:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c9b2d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.064545:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153472 00000100:00100000:3.0:1787790996.064554:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153472 00000100:00100000:3.0:1787790996.064605:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787790996.064614:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:17131:x1874634268153472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787790996.064629:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790996.064655:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f0cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f0c4 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.065823:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f0cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f0c4 expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.065837:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f0cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f0c4 expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790996.065848:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539e00, rc 0) 00000100:00100000:3.0:1787790996.065935:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268153472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1321us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.065943:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787790996.065962:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787790996.065981:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790996.065990:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790996.066062:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790996.066097:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790996.066133:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c9b2d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.067925:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153600 00000100:00100000:3.0:1787790996.067937:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153600 00000100:00100000:3.0:1787790996.067988:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787790996.067997:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c2be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268153600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.068147:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c2be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268153600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.068155:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787790996.068891:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787790996.068947:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787790996.069008:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790996.069039:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c9b2d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787790996.069549:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153728 00000100:00100000:3.0:1787790996.069556:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153728 00000100:00100000:3.0:1787790996.069643:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787790996.069654:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268153728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787790996.069889:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:17131:x1874634268153728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790996.069897:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787790996.069999:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:17131:1874634268153728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787790996.072328:0:20232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787790996.079903:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787790996.079944:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787790996.079957:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790996.079984:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790996.748972:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787790997.771163:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790998.018821:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.018925:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251264 00000100:00100000:1.0:1787790998.018935:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251264 00000100:00100000:1.0:1787790998.019021:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:1.0:1787790998.019032:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:15571:x1874634250251264:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790998.019054:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790998.019078:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5e00/0xcf9477fddcf1f0d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224052 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019149:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019165:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019178:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019208:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019216:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019223:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019431:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5400/0xcf9477fddcf1f0e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019440:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5400/0xcf9477fddcf1f0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019447:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5400/0xcf9477fddcf1f0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790998.019475:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787790998.019479:0:17136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790998.019520:0:17136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5400/0xcf9477fddcf1f0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019531:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019538:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019545:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019561:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790998.019566:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019585:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019598:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:1.0:1787790998.019601:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790998.019607:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019613:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019628:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019634:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019639:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019810:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790998.019813:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019819:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019837:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9170e4e86400) 00010000:00010000:1.0:1787790998.019840:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790998.019844:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019850:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019885:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5e00/0xcf9477fddcf1f0d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224052 expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019900:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5400/0xcf9477fddcf1f0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224052 expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.019908:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e4e86000) 00010000:00010000:1.0:1787790998.019911:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787790998.019913:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5400, rc 0) 00000100:00080000:2.0:1787790998.020061:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787790998.020115:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:15571:x1874634250251264:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1084us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.020125:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:1.0:1787790998.028165:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.028347:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251392 00000100:00100000:3.0:1787790998.028358:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251392 00000100:00100000:3.0:1787790998.028423:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787790998.028434:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:15571:x1874634250251392:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787790998.028527:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:15571:x1874634250251392:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.028535:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:0.0:1787790998.037236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.050128:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251648 00000100:00100000:1.0:1787790998.050154:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251648 00000100:00100000:1.0:1787790998.050270:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:1.0:1787790998.050282:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:15571:x1874634250251648:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790998.050309:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790998.050338:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5e00/0xcf9477fddcf1f0ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224059 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.050478:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.050496:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.050510:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.055730:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.055754:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.055782:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.055955:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4600/0xcf9477fddcf1f103 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.055964:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4600/0xcf9477fddcf1f103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.055971:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4600/0xcf9477fddcf1f103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790998.055982:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787790998.056157:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056175:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056182:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056188:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790998.056193:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056200:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056213:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e4e86000) 00010000:00010000:1.0:1787790998.056216:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790998.056221:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056226:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f0f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056240:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056245:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056251:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056257:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790998.056266:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056273:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056281:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9170e4e86400) 00010000:00010000:1.0:1787790998.056284:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790998.056287:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.056293:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f0fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.064733:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5e00/0xcf9477fddcf1f0ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224059 expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.064769:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4600/0xcf9477fddcf1f103 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224059 expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.064780:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9170e4e86200) 00010000:00010000:2.0:1787790998.064798:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790998.064804:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4600, rc 0) 00000100:00100000:2.0:1787790998.064889:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15571:x1874634250251648:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 14608us (27667us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787790998.064900:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787790998.068822:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.069087:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251776 00000100:00100000:1.0:1787790998.069100:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251776 00000100:00100000:1.0:1787790998.069185:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:1.0:1787790998.069196:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15571:x1874634250251776:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787790998.069336:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15571:x1874634250251776:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 141us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.069344:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:1.0:1787790998.075162:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.077809:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250251904 00000100:00100000:2.0:1787790998.077826:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250251904 00000100:00100000:2.0:1787790998.077996:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:2.0:1787790998.078007:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:15571:x1874634250251904:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787790998.087405:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787790998.090821:0:17136:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 12765us 00000100:00100000:1.0:1787790998.091343:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.092981:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252032 00000100:00100000:3.0:1787790998.093001:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252032 00000100:00100000:3.0:1787790998.093092:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:3.0:1787790998.093105:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15577:x1874634250252032:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790998.093133:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790998.093162:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538a00/0xcf9477fddcf1f111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224060 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093251:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093269:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093283:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093303:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093312:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093320:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093376:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093384:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093406:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093414:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790998.093420:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093429:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093444:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:3.0:1787790998.093448:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790998.093454:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093461:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1f118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093476:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093483:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093490:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093495:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790998.093498:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093517:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093526:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff916fc2686d00) 00010000:00010000:3.0:1787790998.093529:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790998.093532:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093538:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f11f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093577:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538a00/0xcf9477fddcf1f111 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224060 expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093588:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:3.0:1787790998.093591:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790998.093595:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538a00/0xcf9477fddcf1f111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224060 expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.093605:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538a00, rc 0) 00000100:00100000:3.0:1787790998.093696:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15577:x1874634250252032:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 594us (2359us total) trans 0 rc 301/301 00000100:00100000:3.0:1787790998.093745:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:1.0:1787790998.102133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.102267:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252160 00000100:00100000:0.0:1787790998.102281:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252160 00000100:00100000:0.0:1787790998.102355:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:0.0:1787790998.102369:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15577:x1874634250252160:12345-192.168.202.22@tcp:700:lfs.0 00000100:00100000:0.0:1787790998.102489:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15577:x1874634250252160:12345-192.168.202.22@tcp:700:lfs.0 Request processed in 123us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790998.102498:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:0.0:1787790998.105421:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.105510:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252416 00000100:00100000:2.0:1787790998.105523:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252416 00000100:00100000:2.0:1787790998.105596:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787790998.105609:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:15577:x1874634250252416:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:2.0:1787790998.105683:0:19928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790998.105757:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3200/0xcf9477fddcf1f03f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223fcd expref: 9 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.105779:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:2.0:1787790998.105798:0:19928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787790998.105959:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.105976:0:19928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 5 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.105986:0:19928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.106040:0:19928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 5 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.106058:0:19928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 5 pid: 17136 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790998.106075:0:19928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19928:1874634268153856:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790998.106188:0:19928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787790998.109023:0:19928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19928:1874634268153856:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790998.109061:0:19928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790998.109491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.109573:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252544 00000100:00100000:1.0:1787790998.109582:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252544 00010000:00010000:1.0:1787790998.109684:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 6 pid: 17136 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790998.109771:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:1.0:1787790998.109794:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3648b1be-585a-40cf-a928-57e0e7a37168+6:2403:x1874634250252544:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790998.109816:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790998.109825:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 6 pid: 17136 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.109840:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 6 pid: 17136 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.109886:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1f07e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722403d expref: 6 pid: 17136 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.109905:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:1.0:1787790998.109911:0:17119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.109922:0:17119:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.109931:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.109964:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790998.110047:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2403:x1874634250252544:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 265us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.110055:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00010000:00010000:1.0:1787790998.110181:0:19928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.110197:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.110224:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.110236:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.110244:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787790998.113002:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787790998.113500:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113531:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113545:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790998.113568:0:19928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008de4e390 reply state 00000000bc8df6f6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113582:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113591:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:3.0:1787790998.113595:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790998.113601:0:19928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787790998.113609:0:19928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787790998.113620:0:19928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113627:0:19928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113634:0:19928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113641:0:19928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790998.113645:0:19928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113654:0:19928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113679:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc3700f00) 00010000:00010000:3.0:1787790998.113682:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790998.113686:0:19928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113693:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3800/0xcf9477fddcf1f126 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790998.113740:0:19928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008de4e390 reply state 00000000bc8df6f6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113749:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.113756:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9170e4e86400) 00010000:00010000:3.0:1787790998.113758:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790998.113761:0:19928:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787790998.117563:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+10:15577:x1874634250252416:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 11940us (12140us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787790998.117578:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787790998.119429:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:15571:x1874634250251904:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 41411us (44270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.119447:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:0.0:1787790998.177359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.177482:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252672 00000100:00100000:3.0:1787790998.177495:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252672 00000100:00100000:3.0:1787790998.177570:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787790998.177584:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+10:15585:x1874634250252672:12345-192.168.202.22@tcp:101:lctl.0 00010000:00010000:3.0:1787790998.177621:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790998.177649:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f13b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224067 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.177981:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1f142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.178000:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1f142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.178028:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1f142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790998.178083:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790998.178086:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790998.178124:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1f142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.178147:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f13b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224067 expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.178163:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1f142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224067 expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.178170:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:2.0:1787790998.178172:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790998.178175:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fae00, rc 0) 00000100:00100000:2.0:1787790998.178241:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+11:15585:x1874634250252672:12345-192.168.202.22@tcp:101:lctl.0 Request processed in 661us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.178250:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787790998.193196:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.193276:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252800 00000100:00100000:0.0:1787790998.193286:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252800 00000100:00100000:0.0:1787790998.193353:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:0.0:1787790998.193361:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:15586:x1874634250252800:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790998.193385:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790998.193410:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722406e expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.193486:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165ec00/0xcf9477fddcf1f150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.193500:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165ec00/0xcf9477fddcf1f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.193510:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165ec00/0xcf9477fddcf1f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790998.193561:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790998.193564:0:17134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790998.193583:0:17134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165ec00/0xcf9477fddcf1f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.193607:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722406e expref: 7 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.193646:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165ec00/0xcf9477fddcf1f150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722406e expref: 6 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.193656:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:0.0:1787790998.193660:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790998.193664:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165ec00, rc 0) 00000100:00100000:0.0:1787790998.193806:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3648b1be-585a-40cf-a928-57e0e7a37168+6:15586:x1874634250252800:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 445us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790998.193814:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:1.0:1787790998.198244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.201188:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250252928 00000100:00100000:2.0:1787790998.201210:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250252928 00000100:00100000:2.0:1787790998.201323:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:2.0:1787790998.201337:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+6:15586:x1874634250252928:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790998.201366:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790998.201393:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224075 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201509:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201529:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201545:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201559:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201568:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201574:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201676:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3c00/0xcf9477fddcf1f16c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201685:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3c00/0xcf9477fddcf1f16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201693:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3c00/0xcf9477fddcf1f16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790998.201772:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787790998.201777:0:17136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790998.201816:0:17136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3c00/0xcf9477fddcf1f16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.201843:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.203892:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.203915:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.203922:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790998.203935:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.203946:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.203967:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:2.0:1787790998.203970:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790998.203977:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.203986:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204009:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204016:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204023:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204049:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790998.204053:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204059:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204069:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9170e4e86400) 00010000:00010000:2.0:1787790998.204072:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790998.204075:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204082:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f165 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204266:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224075 expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204285:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3c00/0xcf9477fddcf1f16c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224075 expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.204294:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:2.0:1787790998.204297:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787790998.204300:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3c00, rc 0) 00000100:00100000:2.0:1787790998.204408:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+7:15586:x1874634250252928:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 3072us (6177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.204419:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:2.0:1787790998.213948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.214235:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250253056 00000100:00100000:3.0:1787790998.214246:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250253056 00000100:00080000:0.0:1787790998.214321:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787790998.214381:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787790998.214402:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3648b1be-585a-40cf-a928-57e0e7a37168+5:15586:x1874634250253056:12345-192.168.202.22@tcp:900:lfs.0 00000100:00100000:3.0:1787790998.214499:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3648b1be-585a-40cf-a928-57e0e7a37168+5:15586:x1874634250253056:12345-192.168.202.22@tcp:900:lfs.0 Request processed in 101us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.214507:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000040:00080000:1.0:1787790998.220828:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787790998.221881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.222868:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250253312 00000100:00100000:2.0:1787790998.222879:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250253312 00000100:00100000:2.0:1787790998.223001:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:2.0:1787790998.223010:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+7:15586:x1874634250253312:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790998.223040:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790998.223058:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722407c expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790998.223228:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787790998.223347:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f173 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722407c expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.223361:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:2.0:1787790998.223365:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790998.223371:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722407c expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.223386:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2000, rc 0) 00000100:00100000:2.0:1787790998.223470:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+8:15586:x1874634250253312:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 462us (1601us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787790998.223478:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:0.0:1787790998.230344:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.231313:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250253568 00000100:00100000:1.0:1787790998.231333:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250253568 00000100:00100000:1.0:1787790998.231563:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:1.0:1787790998.231577:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3648b1be-585a-40cf-a928-57e0e7a37168+8:15586:x1874634250253568:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:1.0:1787790998.231819:0:19928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790998.231858:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3c00/0xcf9477fddcf1f16c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224075 expref: 8 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.231885:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790998.231893:0:19928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790998.232558:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.232582:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.232953:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787790998.233239:0:19928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3e7cb21 reply state 00000000f3b6bbc2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.233255:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.233264:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790998.233268:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787790998.233272:0:19928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787790998.233282:0:19928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787790998.233419:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3648b1be-585a-40cf-a928-57e0e7a37168+9:15586:x1874634250253568:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 1841us (3087us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787790998.233447:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:1.0:1787790998.239423:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.239908:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250253824 00000100:00100000:0.0:1787790998.239923:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250253824 00000100:00100000:0.0:1787790998.240006:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:0.0:1787790998.240020:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3648b1be-585a-40cf-a928-57e0e7a37168+9:15586:x1874634250253824:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790998.240349:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3648b1be-585a-40cf-a928-57e0e7a37168+10:15586:x1874634250253824:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 331us (942us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787790998.240359:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:3.0:1787790998.255579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.256575:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250254080 00000100:00100000:2.0:1787790998.256591:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250254080 00000100:00100000:2.0:1787790998.256689:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:2.0:1787790998.256701:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+10:15586:x1874634250254080:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787790998.256779:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790998.256819:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224083 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.256944:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.256963:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.256979:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.256992:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257000:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257007:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790998.257233:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787790998.257340:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257349:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257357:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257364:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790998.257369:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257394:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257410:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:2.0:1787790998.257414:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790998.257420:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257427:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f18f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257854:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257861:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257868:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257874:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790998.257877:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257885:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257895:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9170e4e86400) 00010000:00010000:2.0:1787790998.257898:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790998.257901:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.257920:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3600/0xcf9477fddcf1f196 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.258112:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f188 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224083 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.258125:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:2.0:1787790998.258127:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787790998.258205:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224083 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.258217:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3400, rc 0) 00000100:00100000:2.0:1787790998.258319:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+11:15586:x1874634250254080:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1620us (2755us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787790998.258329:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:2.0:1787790998.262210:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.267794:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250254208 00000100:00100000:0.0:1787790998.267814:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250254208 00000100:00100000:0.0:1787790998.270551:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:0.0:1787790998.270585:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+11:15586:x1874634250254208:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787790998.270621:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790998.270656:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f1a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722408a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.270850:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.270869:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.270886:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790998.270917:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787790998.270921:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787790998.270956:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.270991:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f1a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.271016:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.271027:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:0.0:1787790998.271030:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787790998.271036:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165f600, rc 0) 00000100:00100000:0.0:1787790998.271138:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+12:15586:x1874634250254208:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 571us (9012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790998.271149:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:1.0:1787790998.276881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.276991:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250254336 00000100:00100000:0.0:1787790998.277005:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250254336 00000100:00100000:0.0:1787790998.277103:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:0.0:1787790998.277115:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3648b1be-585a-40cf-a928-57e0e7a37168+12:15586:x1874634250254336:12345-192.168.202.22@tcp:37:lfs.0 00000100:00100000:1.0:1787790998.287339:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3648b1be-585a-40cf-a928-57e0e7a37168+12:15586:x1874634250254336:12345-192.168.202.22@tcp:37:lfs.0 Request processed in 10207us (10457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.287364:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:2.0:1787790998.293355:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.293587:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250254592 00000100:00100000:3.0:1787790998.293612:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250254592 00000100:00100000:3.0:1787790998.294759:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:3.0:1787790998.294792:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbeaec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3648b1be-585a-40cf-a928-57e0e7a37168+12:15586:x1874634250254592:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:3.0:1787790998.295118:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbeaec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3648b1be-585a-40cf-a928-57e0e7a37168+13:15586:x1874634250254592:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 346us (1778us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787790998.295127:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:0.0:1787790998.343687:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.344080:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250254720 00000100:00100000:1.0:1787790998.344092:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250254720 00000100:00100000:1.0:1787790998.344233:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:1.0:1787790998.344245:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+11:15592:x1874634250254720:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787790998.344273:0:19928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790998.344301:0:19928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4a00/0xcf9477fddcf1f1b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224091 expref: -99 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344408:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344541:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344557:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344572:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344580:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344587:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344796:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5600/0xcf9477fddcf1f1c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344807:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5600/0xcf9477fddcf1f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.344814:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5600/0xcf9477fddcf1f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790998.345507:0:19928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787790998.345515:0:19928:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787790998.345573:0:19928:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5600/0xcf9477fddcf1f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345677:0:19928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345685:0:19928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345693:0:19928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345699:0:19928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790998.345733:0:19928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345742:0:19928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345758:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:1.0:1787790998.345761:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790998.345766:0:19928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345773:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4200/0xcf9477fddcf1f1b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345801:0:19928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345808:0:19928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345814:0:19928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345826:0:19928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5a00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790998.345829:0:19928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345835:0:19928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345844:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9170e4e86400) 00010000:00010000:1.0:1787790998.345847:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790998.345849:0:19928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345855:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5a00/0xcf9477fddcf1f1c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345898:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4a00/0xcf9477fddcf1f1b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224091 expref: 13 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345913:0:19928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5600/0xcf9477fddcf1f1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224091 expref: 12 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.345921:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790998.345923:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787790998.346370:0:19928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5600, rc 0) 00000100:00100000:1.0:1787790998.346776:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+12:15592:x1874634250254720:12345-192.168.202.22@tcp:101:bash.0 Request processed in 2530us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.346797:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:1.0:1787790998.347446:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787790998.350015:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268153984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787790998.350119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790998.350412:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268153984 00000100:00100000:0.0:1787790998.350434:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268153984 00000100:00100000:0.0:1787790998.350525:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790998.350538:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268153984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787790998.350580:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787790998.350659:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268153984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790998.350667:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787790998.350852:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268153984:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787790998.351091:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787790998.352867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.352968:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250254848 00000100:00100000:1.0:1787790998.352979:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250254848 00000100:00100000:1.0:1787790998.353046:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787790998.353056:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:15592:x1874634250254848:12345-192.168.202.22@tcp:900:bash.0 00000100:00100000:1.0:1787790998.353160:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:15592:x1874634250254848:12345-192.168.202.22@tcp:900:bash.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.353169:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787790998.356399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.356572:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250255104 00000100:00100000:0.0:1787790998.356584:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250255104 00000100:00100000:0.0:1787790998.356665:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:0.0:1787790998.356677:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+12:15592:x1874634250255104:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787790998.356748:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790998.356777:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f800/0xcf9477fddcf1f1ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224098 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.357301:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.357322:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.357334:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.357394:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.357410:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 12 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790998.357440:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17134:1874634268154112:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790998.357552:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790998.361273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.361421:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250255232 00000100:00100000:1.0:1787790998.361444:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250255232 00010000:00010000:1.0:1787790998.361501:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 13 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790998.361554:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:1.0:1787790998.361565:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3648b1be-585a-40cf-a928-57e0e7a37168+13:2402:x1874634250255232:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790998.361586:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790998.361594:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 13 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.361619:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 13 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.361651:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790998.361658:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.361691:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.361700:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.361769:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790998.361842:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3648b1be-585a-40cf-a928-57e0e7a37168+13:2402:x1874634250255232:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 279us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.361851:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00010000:00010000:3.0:1787790998.362816:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f1ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722408a expref: 12 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790998.362841:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17134:1874634268154112:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790998.362868:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.362878:0:17134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.362885:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.362946:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.362960:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.362969:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363634:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363646:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363654:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790998.363668:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787790998.363701:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363774:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363793:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363800:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790998.363805:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363827:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363842:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:3.0:1787790998.363845:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790998.363850:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363857:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f1d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787790998.363871:0:17134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddccf749 reply state 000000003504b95c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363882:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363889:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff916fc2686e00) 00010000:00010000:3.0:1787790998.363891:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787790998.363895:0:17134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787790998.363939:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f800/0xcf9477fddcf1f1ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 15 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363955:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 14 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.363963:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790998.363966:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787790998.363968:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa600, rc 0) 00000100:00100000:3.0:1787790998.364052:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+15:15592:x1874634250255104:12345-192.168.202.22@tcp:101:bash.0 Request processed in 7377us (7668us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787790998.364061:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:0.0:1787790998.381907:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.382175:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250255360 00000100:00100000:2.0:1787790998.382190:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250255360 00000100:00100000:2.0:1787790998.382266:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:2.0:1787790998.382278:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+15:15592:x1874634250255360:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787790998.382314:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790998.382345:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2600/0xcf9477fddcf1f1f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722409f expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382471:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382487:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382499:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787790998.382563:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787790998.382567:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787790998.382588:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382607:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382632:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2600/0xcf9477fddcf1f1f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382648:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.382654:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790998.382657:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787790998.382660:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3000, rc 0) 00000100:00100000:2.0:1787790998.382773:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:15592:x1874634250255360:12345-192.168.202.22@tcp:101:bash.0 Request processed in 498us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.382778:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:2.0:1787790998.385321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.385565:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250255616 00000100:00100000:1.0:1787790998.385576:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250255616 00000100:00100000:1.0:1787790998.385671:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:1.0:1787790998.385680:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:15592:x1874634250255616:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:1.0:1787790998.386091:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+17:15592:x1874634250255616:12345-192.168.202.22@tcp:35:bash.0 Request processed in 407us (778us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787790998.386100:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:0.0:1787790998.456203:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.456348:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250255872 00000100:00100000:1.0:1787790998.456359:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250255872 00000100:00100000:1.0:1787790998.456424:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:1.0:1787790998.456446:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+17:15602:x1874634250255872:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787790998.456484:0:19928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790998.456516:0:19928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4a00/0xcf9477fddcf1f1ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240a6 expref: -99 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790998.456653:0:19928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787790998.456853:0:19928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4a00/0xcf9477fddcf1f1ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240a6 expref: 19 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.456890:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:1.0:1787790998.456894:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787790998.456901:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4a00/0xcf9477fddcf1f1ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240a6 expref: 19 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.456919:0:19928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4a00, rc 0) 00000100:00100000:1.0:1787790998.457109:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+18:15602:x1874634250255872:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 670us (918us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787790998.457118:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:0.0:1787790998.461590:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.461876:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250256128 00000100:00100000:3.0:1787790998.461890:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250256128 00000100:00100000:3.0:1787790998.461976:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787790998.461989:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+18:15602:x1874634250256128:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:3.0:1787790998.462302:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+19:15602:x1874634250256128:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 315us (721us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787790998.462311:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:2.0:1787790998.469099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.469157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.469212:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.469240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.469610:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250256256 00000100:00100000:1.0:1787790998.469623:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250256256 00000100:00100000:1.0:1787790998.469694:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 165 00000100:00100000:1.0:1787790998.469741:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250256256:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790998.469862:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250256256:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 157us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.469871:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 165 00000100:00100000:3.0:1787790998.474043:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250256384 00000100:00100000:3.0:1787790998.474067:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250256384 00000100:00100000:3.0:1787790998.474183:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250256640 00000100:00100000:3.0:1787790998.474187:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250256640 00000100:00100000:3.0:1787790998.474220:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:3.0:1787790998.474232:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250256384:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790998.474336:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250256384:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 106us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.474344:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:3.0:1787790998.474365:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:3.0:1787790998.474372:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250256640:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790998.474397:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250256640:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.474403:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00080000:1.0:1787790998.474516:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787790998.475789:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.475842:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250256512 00000100:00100000:3.0:1787790998.475878:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250256512 00000100:00100000:3.0:1787790998.475956:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250256768 00000100:00100000:3.0:1787790998.475959:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250256768 00000100:00100000:3.0:1787790998.475984:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00080000:2.0:1787790998.476029:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787790998.476070:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250256512:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787790998.476144:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250256512:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 151us (6903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.477844:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:1.0:1787790998.477876:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250256768:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787790998.477954:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3648b1be-585a-40cf-a928-57e0e7a37168+5:2401:x1874634250256768:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 96us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.477964:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787790998.480731:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787790998.501560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.501804:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250257024 00000100:00100000:3.0:1787790998.501818:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250257024 00000100:00100000:3.0:1787790998.502215:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:3.0:1787790998.502229:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+19:15605:x1874634250257024:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787790998.502261:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790998.502290:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f20d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240ad expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.502616:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f214 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.502634:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f214 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.502648:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f214 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790998.502663:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787790998.502834:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f20d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ad expref: 22 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.502882:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f214 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ad expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.502893:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790998.502896:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790998.502900:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:3.0:1787790998.502998:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+21:15605:x1874634250257024:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 772us (1453us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787790998.503007:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:2.0:1787790998.506686:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.508380:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250257152 00000100:00100000:3.0:1787790998.508400:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250257152 00000100:00100000:3.0:1787790998.508506:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:3.0:1787790998.508520:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+21:15605:x1874634250257152:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787790998.508618:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508641:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508656:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508736:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508745:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508777:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508795:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790998.508800:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508809:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508825:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790998.508829:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787790998.508835:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.508843:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f222 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790998.509372:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+21:15605:x1874634250257152:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 848us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.509384:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:1.0:1787790998.510383:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.510543:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250257280 00000100:00100000:0.0:1787790998.510554:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250257280 00000100:00100000:0.0:1787790998.510620:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:0.0:1787790998.510631:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+21:2400:x1874634250257280:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790998.510649:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790998.510677:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f214 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ad expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.510696:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:0.0:1787790998.510724:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790998.510769:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+20:2400:x1874634250257280:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 140us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790998.510776:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:2.0:1787790998.513326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.513484:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250257536 00000100:00100000:0.0:1787790998.513496:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250257536 00000100:00100000:0.0:1787790998.513598:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:0.0:1787790998.513611:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+20:15605:x1874634250257536:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787790998.514106:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+21:15605:x1874634250257536:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 495us (789us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787790998.514116:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787790998.723362:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.723561:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250257792 00000100:00100000:1.0:1787790998.723574:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250257792 00000100:00100000:1.0:1787790998.723656:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:1.0:1787790998.723669:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+21:15636:x1874634250257792:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:1.0:1787790998.723702:0:19928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790998.723773:0:19928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f229 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240b4 expref: -99 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.723935:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f230 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.723953:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.723968:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787790998.723982:0:19928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787790998.724140:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f229 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240b4 expref: 24 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.724164:0:19928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f230 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240b4 expref: 23 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.724174:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:1.0:1787790998.724178:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787790998.724182:0:19928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5000, rc 0) 00000100:00100000:1.0:1787790998.724268:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:15636:x1874634250257792:12345-192.168.202.22@tcp:101:cat.0 Request processed in 602us (922us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787790998.724296:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:3.0:1787790998.734595:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.734746:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250257920 00000100:00100000:0.0:1787790998.734760:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250257920 00000100:00100000:0.0:1787790998.734870:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:0.0:1787790998.734885:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:2403:x1874634250257920:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790998.734908:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790998.734955:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5000/0xcf9477fddcf1f230 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240b4 expref: 23 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.734986:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:0.0:1787790998.734993:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790998.735087:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+22:2403:x1874634250257920:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 205us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790998.735097:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000040:00080000:1.0:1787790998.735615:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787790998.739141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.740187:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250258176 00000100:00100000:1.0:1787790998.740203:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250258176 00000100:00100000:1.0:1787790998.740286:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787790998.740298:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+22:15636:x1874634250258176:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:1.0:1787790998.740773:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:15636:x1874634250258176:12345-192.168.202.22@tcp:35:cat.0 Request processed in 474us (1644us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787790998.740799:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00010000:00010000:1.0:1787790998.798901:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787790998.819509:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.819693:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250258432 00000100:00100000:3.0:1787790998.819746:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250258432 00000100:00100000:3.0:1787790998.819829:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:3.0:1787790998.819842:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:15642:x1874634250258432:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787790998.820099:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790998.820186:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f23e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240bb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820323:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820338:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820348:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820357:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820403:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820420:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 24 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790998.820436:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17134:1874634268154240:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790998.820612:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.820622:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790998.820632:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17134:1874634268154368:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787790998.820661:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76000 going to sleep for 11 seconds 00000100:00100000:0.0:1787790998.827977:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17134:1874634268154240:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790998.830570:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.831006:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250258560 00000100:00100000:1.0:1787790998.831020:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250258560 00010000:00010000:1.0:1787790998.831089:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 25 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790998.831139:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787790998.831152:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+25:2400:x1874634250258560:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787790998.831173:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790998.831183:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 25 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.831200:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 25 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.831230:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f1f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722409f expref: 25 pid: 17135 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.831271:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:1.0:1787790998.831278:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.831288:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.831297:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790998.831382:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+24:2400:x1874634250258560:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 233us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.831391:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787790998.831572:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17134:1874634268154368:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787790998.831605:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790998.833209:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.833349:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250258688 00000100:00100000:2.0:1787790998.833361:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250258688 00010000:00010000:2.0:1787790998.833405:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790998.833454:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787790998.833464:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+24:2403:x1874634250258688:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790998.833479:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790998.833485:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.833498:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.833522:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f1e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224098 expref: 24 pid: 17134 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.833541:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790998.833562:0:17121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.833572:0:17121:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.833581:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.833626:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787790998.833662:0:17134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.833671:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790998.833693:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:2403:x1874634250258688:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 230us (494us total) trans 0 rc 0/0 00000004:00200000:3.0:1787790998.833695:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:2.0:1787790998.833701:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00010000:00010000:3.0:1787790998.833955:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f23e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240bb expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.833973:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240bb expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.833980:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790998.833984:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787790998.833986:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fbc00, rc 0) 00000100:00100000:3.0:1787790998.834072:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:15642:x1874634250258432:12345-192.168.202.22@tcp:101:dd.0 Request processed in 14233us (14579us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787790998.834081:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:3.0:1787790998.838354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790998.839177:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250258816 00000100:00100000:2.0:1787790998.839193:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250258816 00000100:00100000:2.0:1787790998.839404:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:2.0:1787790998.839416:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+23:15642:x1874634250258816:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:2.0:1787790998.839461:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790998.839490:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f253 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.839535:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.839554:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.839568:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.839757:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3400/0xcf9477fddcf1f253 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 25 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.839797:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790998.839808:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790998.839811:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790998.839815:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2000, rc 0) 00000100:00100000:2.0:1787790998.839920:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+24:15642:x1874634250258816:12345-192.168.202.22@tcp:101:dd.0 Request processed in 506us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.840172:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:2.0:1787790998.844908:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790998.845029:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259072 00000100:00100000:0.0:1787790998.845043:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259072 00000100:00100000:0.0:1787790998.845117:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:0.0:1787790998.845130:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+24:15642:x1874634250259072:12345-192.168.202.22@tcp:36:dd.0 00010000:00010000:0.0:1787790998.845652:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.845675:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.845688:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790998.845795:0:19928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787790998.845824:0:19928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025255b9d reply state 00000000eb6ebcb5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.845840:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790998.845849:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:0.0:1787790998.845852:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790998.845856:0:19928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790998.845982:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+27:15642:x1874634250259072:12345-192.168.202.22@tcp:36:dd.0 Request processed in 853us (1086us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787790998.845991:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000020:00080000:0.0:1787790998.845999:0:19928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787790998.849455:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.849553:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259200 00000100:00100000:3.0:1787790998.849567:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259200 00000100:00100000:3.0:1787790998.849666:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:3.0:1787790998.849679:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+27:15642:x1874634250259200:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787790998.849744:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790998.849774:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f268 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240c9 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.849871:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f268 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c9 expref: 28 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.849890:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f268 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c9 expref: 28 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.849915:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790998.849920:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790998.849934:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:3.0:1787790998.850020:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15642:x1874634250259200:12345-192.168.202.22@tcp:101:dd.0 Request processed in 344us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.850027:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:1.0:1787790998.859037:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787790998.859070:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268154496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787790998.859190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790998.859339:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268154496 00000100:00100000:2.0:1787790998.859350:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268154496 00000100:00100000:2.0:1787790998.859416:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787790998.859444:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268154496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787790998.859493:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787790998.859563:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268154496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.859571:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787790998.859912:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268154624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787790998.859962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787790998.860053:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268154496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787790998.860146:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268154624 00000100:00100000:2.0:1787790998.860151:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268154624 00000100:00100000:2.0:1787790998.860194:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787790998.860202:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268154624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787790998.860235:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787790998.860283:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268154624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.860307:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787790998.860326:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268154624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787790998.871585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790998.871673:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259456 00000100:00100000:1.0:1787790998.871687:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259456 00000100:00100000:1.0:1787790998.871849:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:1.0:1787790998.871863:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15642:x1874634250259456:12345-192.168.202.22@tcp:103:dd.0 00010000:00010000:1.0:1787790998.872041:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790998.872091:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f268 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c9 expref: 28 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790998.872138:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:1.0:1787790998.872145:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787790998.872215:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+27:15642:x1874634250259456:12345-192.168.202.22@tcp:103:dd.0 Request processed in 355us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790998.872222:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:2.0:1787790998.876234:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.876471:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259584 00000100:00100000:3.0:1787790998.876484:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259584 00000100:00100000:3.0:1787790998.876567:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:3.0:1787790998.876580:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+27:15642:x1874634250259584:12345-192.168.202.22@tcp:58:dd.0 00010000:00010000:3.0:1787790998.876810:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.876834:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.876862:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787790998.880996:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787790998.881601:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787790998.882627:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787790998.883020:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+27:15642:x1874634250259584:12345-192.168.202.22@tcp:58:dd.0 Request processed in 6433us (6801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790998.883035:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:0.0:1787790998.888150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790998.888833:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259712 00000100:00100000:3.0:1787790998.888847:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259712 00000100:00100000:3.0:1787790998.888947:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:3.0:1787790998.888959:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+27:15642:x1874634250259712:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787790998.888989:0:18527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790998.889016:0:18527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240d0 expref: -99 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.889092:0:18527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.889103:0:18527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 28 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.889126:0:18527:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.889141:0:18527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 28 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.889158:0:18527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790998.889162:0:18527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787790998.889167:0:18527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 28 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790998.889199:0:18527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:3.0:1787790998.889591:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15642:x1874634250259712:12345-192.168.202.22@tcp:101:dd.0 Request processed in 632us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790998.889600:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000040:00080000:1.0:1787790999.244962:0:17168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787790999.244977:0:17168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790999.245047:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787790999.245061:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787790999.245262:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdca1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17168:1874634268154752:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787790999.245398:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f39ef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.252699:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdca1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17168:1874634268154752:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787790999.259150:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.259341:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259840 00000100:00100000:0.0:1787790999.259355:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259840 00000100:00100000:0.0:1787790999.259451:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:0.0:1787790999.259464:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15644:x1874634250259840:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787790999.259529:0:17135:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787790999.260050:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15644:x1874634250259840:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 587us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.260060:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:0.0:1787790999.264194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.264368:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250259968 00000100:00100000:3.0:1787790999.264383:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250259968 00000100:00100000:3.0:1787790999.264475:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:3.0:1787790999.264490:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15644:x1874634250259968:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787790999.264608:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.264631:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.264649:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269737:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269786:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269803:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269841:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269868:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269877:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790999.269935:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787790999.269941:0:17136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787790999.269961:0:17136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269973:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269980:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269987:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.269993:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790999.269997:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270005:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270016:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9170e4e86200) 00010000:00010000:3.0:1787790999.270019:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790999.270024:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270040:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f27d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270057:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270063:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270070:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270075:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790999.270077:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270083:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270089:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff916fc2686400) 00010000:00010000:3.0:1787790999.270092:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790999.270094:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270100:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f284 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270114:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270118:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270128:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270133:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787790999.270136:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270142:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270151:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787790999.270153:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787790999.270156:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.270162:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f28b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790999.270299:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15644:x1874634250259968:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 5797us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.270314:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:3.0:1787790999.275233:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.275351:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250260224 00000100:00100000:0.0:1787790999.275368:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250260224 00000100:00100000:0.0:1787790999.275519:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787790999.275533:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+28:15644:x1874634250260224:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787790999.275562:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787790999.275602:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f800/0xcf9477fddcf1f292 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240d7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.277317:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.277348:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.277365:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787790999.277387:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787790999.279396:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279419:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279461:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279468:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165fe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787790999.279473:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279483:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279505:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:0.0:1787790999.279508:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787790999.279514:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279520:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165fe00/0xcf9477fddcf1f299 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279618:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f800/0xcf9477fddcf1f292 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d7 expref: 30 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279630:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9170e4e86200) 00010000:00010000:0.0:1787790999.279633:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787790999.279637:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f800/0xcf9477fddcf1f292 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d7 expref: 30 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.279649:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165f800, rc 0) 00000100:00100000:0.0:1787790999.283784:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+29:15644:x1874634250260224:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 8220us (8528us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787790999.283831:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:2.0:1787790999.293434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.293578:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250260352 00000100:00100000:0.0:1787790999.293591:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250260352 00000100:00100000:3.0:1787790999.293965:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:3.0:1787790999.293990:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+29:15644:x1874634250260352:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787790999.294031:0:18527:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787790999.294171:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+29:15644:x1874634250260352:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 192us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.294180:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:1.0:1787790999.298283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.299339:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250260608 00000100:00100000:3.0:1787790999.299357:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250260608 00000100:00100000:3.0:1787790999.299516:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:3.0:1787790999.299529:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+29:15644:x1874634250260608:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790999.299558:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790999.299586:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240de expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787790999.303118:0:17136:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:3.0:1787790999.303135:0:17136:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787790999.303166:0:17136:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787790999.304771:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.304805:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.304819:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.304917:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240de expref: 32 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.304941:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240de expref: 31 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.304950:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff916fc2686400) 00010000:00010000:3.0:1787790999.304954:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787790999.304958:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:3.0:1787790999.305084:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+31:15644:x1874634250260608:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 5557us (6816us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787790999.305094:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:2.0:1787790999.317418:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.327727:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250260864 00000100:00100000:0.0:1787790999.327751:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250260864 00000100:00100000:1.0:1787790999.329995:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:1.0:1787790999.330014:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+31:15644:x1874634250260864:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787790999.330089:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787790999.330123:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240de expref: 31 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.330149:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff916fc2686400) 00010000:00010000:1.0:1787790999.330163:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787790999.330194:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.330211:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.330243:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.331876:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.331904:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.331919:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.331988:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.331995:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332012:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332018:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.332022:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332030:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332043:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790999.332046:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790999.332051:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332086:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332104:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332110:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332116:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332121:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.332124:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332130:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332138:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6513dc18 (ffff9170e4e86b00) 00010000:00010000:1.0:1787790999.332141:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790999.332144:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.332150:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6513dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790999.332341:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+30:15644:x1874634250260864:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 2326us (14932us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787790999.332361:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:2.0:1787790999.351226:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790999.351342:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250260992 00000100:00100000:1.0:1787790999.351361:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250260992 00000100:00100000:1.0:1787790999.351432:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:1.0:1787790999.351443:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+30:15644:x1874634250260992:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790999.351464:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790999.351488:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240e5 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.351528:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.351543:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.351553:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.351676:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240e5 expref: 32 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.351695:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240e5 expref: 31 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.351751:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:1.0:1787790999.351755:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787790999.351759:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5c00, rc 0) 00000100:00100000:1.0:1787790999.351833:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+31:15644:x1874634250260992:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 391us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790999.351841:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:0.0:1787790999.359944:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.360416:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250261248 00000100:00100000:3.0:1787790999.360442:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250261248 00000100:00100000:3.0:1787790999.360528:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:3.0:1787790999.360540:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+31:15644:x1874634250261248:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787790999.360693:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.360781:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.360797:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787790999.361523:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787790999.361538:0:17136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 548309831760ns, next at 549309829032ns, rc = 0 00000004:00010000:1.0:1787790999.361616:0:17136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b728a679 reply state 000000008c0fcd43 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.361638:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.361648:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:1.0:1787790999.361650:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787790999.361656:0:17136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787790999.361856:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+33:15644:x1874634250261248:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1314us (1928us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787790999.361865:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:3.0:1787790999.368959:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790999.369199:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250261376 00000100:00100000:1.0:1787790999.369215:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250261376 00000100:00100000:1.0:1787790999.369359:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:1.0:1787790999.369372:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+33:15644:x1874634250261376:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787790999.369398:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787790999.369421:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240ec expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.369488:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 34 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.369504:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 34 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.369523:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:1.0:1787790999.369543:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787790999.369547:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4800, rc 0) 00000100:00100000:1.0:1787790999.369633:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+34:15644:x1874634250261376:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 263us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790999.369640:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:3.0:1787790999.373506:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268154880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787790999.373627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.376801:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268154880 00000100:00100000:0.0:1787790999.376813:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268154880 00000100:00100000:0.0:1787790999.376882:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790999.376895:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268154880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787790999.376928:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787790999.377017:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268154880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.377025:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790999.377091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268155008:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377169:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268155520:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377216:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268156032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377253:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268156544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787790999.377277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377297:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787790999.377303:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268155136:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377362:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268155648:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377403:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268156160:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377465:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268155264:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377509:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268155776:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377546:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268156288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377585:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787790999.377591:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268155392:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377624:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268155904:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377655:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268156416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.377673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.377744:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268154880:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787790999.377783:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790999.377798:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156544 00000100:00100000:0.0:1787790999.377802:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156544 00000100:00100000:0.0:1787790999.377831:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790999.377838:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268156544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787790999.377853:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787790999.377889:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268156544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.377903:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790999.377925:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155136 00000100:00100000:0.0:1787790999.377929:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155136 00000100:00100000:0.0:1787790999.377952:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155648 00000100:00100000:0.0:1787790999.377954:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155648 00000100:00100000:0.0:1787790999.377969:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790999.377975:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268155136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378010:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268155136:12345-0@lo:400:kworker.0 Request processed in 35us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378017:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787790999.378028:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790999.378034:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268155648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378061:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268155648:12345-0@lo:400:kworker.0 Request processed in 27us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378066:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787790999.378084:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155264 00000100:00100000:0.0:1787790999.378088:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155264 00000100:00100000:0.0:1787790999.378112:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155776 00000100:00100000:0.0:1787790999.378115:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155776 00000100:00100000:0.0:1787790999.378127:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155392 00000100:00100000:0.0:1787790999.378129:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155392 00000100:00100000:0.0:1787790999.378140:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790999.378146:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268155264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378179:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268155264:12345-0@lo:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378185:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787790999.378197:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790999.378210:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268155776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378238:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268155776:12345-0@lo:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378243:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787790999.378253:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790999.378258:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268155392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378282:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268155392:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378288:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787790999.378310:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155520 00000100:00100000:0.0:1787790999.378315:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155520 00000100:00100000:0.0:1787790999.378331:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156032 00000100:00100000:0.0:1787790999.378334:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156032 00000100:00100000:0.0:1787790999.378345:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156160 00000100:00100000:0.0:1787790999.378347:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156160 00000100:00100000:0.0:1787790999.378358:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156288 00000100:00100000:0.0:1787790999.378360:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156288 00000100:00100000:0.0:1787790999.378372:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155904 00000100:00100000:0.0:1787790999.378375:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155904 00000100:00100000:0.0:1787790999.378384:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156416 00000100:00100000:0.0:1787790999.378386:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156416 00000100:00100000:0.0:1787790999.378399:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790999.378406:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268155520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378436:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268155520:12345-0@lo:400:kworker.0 Request processed in 31us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378442:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787790999.378454:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790999.378460:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268156032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378511:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268156032:12345-0@lo:400:kworker.0 Request processed in 51us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378518:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787790999.378530:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790999.378536:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268156160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378562:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268156160:12345-0@lo:400:kworker.0 Request processed in 27us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378567:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787790999.378578:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790999.378584:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268156288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378608:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268156288:12345-0@lo:400:kworker.0 Request processed in 24us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378612:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787790999.378623:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787790999.378628:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268155904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378651:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268155904:12345-0@lo:400:kworker.0 Request processed in 24us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378657:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787790999.378667:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787790999.378672:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268156416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378698:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268156416:12345-0@lo:400:kworker.0 Request processed in 25us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.378703:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787790999.378742:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787790999.378746:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787790999.378754:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787790999.378756:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787790999.378800:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268155392:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378811:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268155904:0@lo:400:kworker.0 00010000:00080000:0.0:1787790999.378821:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b14f00 x1874634268156416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790999.378832:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268156416:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378842:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268155264:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378851:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268155776:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378859:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268156288:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378901:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268155136:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378911:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268155648:0@lo:400:kworker.0 00010000:00080000:0.0:1787790999.378921:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37670c0 x1874634268156160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787790999.378930:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268156160:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378939:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268155520:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378949:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268156032:0@lo:400:kworker.0 00000100:00100000:0.0:1787790999.378962:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268156544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787790999.380412:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268155008 00000100:00100000:3.0:1787790999.380420:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268155008 00000100:00100000:3.0:1787790999.380467:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787790999.380476:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3640:x1874634268155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787790999.380536:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3640:x1874634268155008:12345-0@lo:400:kworker.0 Request processed in 62us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.380543:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787790999.380595:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268155008:0@lo:400:kworker.0 00000100:00100000:3.0:1787790999.380640:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787790999.380649:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268156672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787790999.380684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787790999.380741:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156672 00000100:00100000:3.0:1787790999.380746:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156672 00000100:00100000:3.0:1787790999.380782:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790999.380789:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268156672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787790999.380803:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787790999.380839:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268156672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.380845:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787790999.380887:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268156672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787790999.381405:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790999.381427:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250261504 00000100:00100000:2.0:1787790999.381431:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250261504 00000100:00100000:2.0:1787790999.381460:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:2.0:1787790999.381467:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250261504:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787790999.381686:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2402:x1874634250261504:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 218us (282us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787790999.381694:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:0.0:1787790999.390547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790999.394332:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250261760 00000100:00100000:1.0:1787790999.394357:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250261760 00000100:00100000:1.0:1787790999.394424:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:1.0:1787790999.394435:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+34:15644:x1874634250261760:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787790999.394685:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+35:15644:x1874634250261760:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 251us (4148us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787790999.394694:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:2.0:1787790999.400059:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.400556:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250262016 00000100:00100000:0.0:1787790999.400567:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250262016 00000100:00100000:0.0:1787790999.400647:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:0.0:1787790999.400658:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+35:15644:x1874634250262016:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787790999.400805:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+35:15644:x1874634250262016:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 149us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.400813:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:2.0:1787790999.419770:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.420114:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250262144 00000100:00100000:3.0:1787790999.420126:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250262144 00000100:00100000:3.0:1787790999.420197:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:3.0:1787790999.420208:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+35:15644:x1874634250262144:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790999.420236:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790999.420260:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f2e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240f3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.420337:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.420352:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.420364:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787790999.420423:0:17136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787790999.420444:0:17136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.420470:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa600/0xcf9477fddcf1f2e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240f3 expref: 37 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.420487:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240f3 expref: 36 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.420495:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:3.0:1787790999.420498:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787790999.420501:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:3.0:1787790999.420561:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+36:15644:x1874634250262144:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 355us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.420567:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:1.0:1787790999.429874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.430526:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250262272 00000100:00100000:3.0:1787790999.430539:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250262272 00000100:00100000:3.0:1787790999.430599:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787790999.430610:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+6:2403:x1874634250262272:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787790999.430629:0:19573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787790999.430651:0:19573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272240fa expref: -99 pid: 19573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787790999.430688:0:19573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f8698, blocks: 0x0 00010000:00010000:3.0:1787790999.430755:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1787790999.430782:0:19573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787790999.430793:0:19573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 7 pid: 19573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.430814:0:19573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 7 pid: 19573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787790999.430830:0:19573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa600, rc 0) 00000100:00100000:3.0:1787790999.430893:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2403:x1874634250262272:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 286us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.430901:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787790999.456971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790999.457164:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250262528 00000100:00100000:1.0:1787790999.457177:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250262528 00000100:00100000:1.0:1787790999.457259:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:1.0:1787790999.457272:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+36:15644:x1874634250262528:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787790999.457444:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+36:15644:x1874634250262528:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 173us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790999.457453:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:0.0:1787790999.465536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790999.466056:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250262656 00000100:00100000:2.0:1787790999.466259:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250262656 00000100:00100000:2.0:1787790999.470226:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:2.0:1787790999.470249:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+36:15644:x1874634250262656:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787790999.474175:0:17114:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787790999.474198:0:17114:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787790999.474274:0:17114:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787790999.474458:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787790999.474491:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268156800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787790999.474542:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+19:15644:x1874634250262656:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 4295us (9013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790999.474558:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:0.0:1787790999.474601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790999.474645:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268156800 00000100:00100000:2.0:1787790999.474654:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268156800 00000100:00100000:2.0:1787790999.474695:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787790999.475094:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.475113:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.475135:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.475161:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.475167:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.475177:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.475199:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790999.475203:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787790999.475219:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.475226:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5200/0xcf9477fddcf1f181 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.475403:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268156800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787790999.475537:0:19281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787790999.475540:0:19281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787790999.475543:0:19281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787790999.475545:0:19281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787791000 -> 1787791000 00002000:00010000:2.0:1787790999.475547:0:19281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787790999.475666:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268156800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 963us (1077us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787790999.475683:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1787790999.477847:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170e4d58f00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1787790999.477867:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268156800:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787790999.483500:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483529:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483537:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483544:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.483550:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483558:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483618:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9170e4e86400) 00010000:00010000:1.0:1787790999.483622:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790999.483629:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483636:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5800/0xcf9477fddcf1f12d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483676:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483683:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483689:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483694:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.483696:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483703:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483737:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:1.0:1787790999.483749:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790999.483759:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483765:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fa200/0xcf9477fddcf1f134 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483806:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483812:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483818:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483823:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26faa00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.483826:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483833:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483841:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff916fc2686e00) 00010000:00010000:1.0:1787790999.483843:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790999.483846:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483861:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26faa00/0xcf9477fddcf1f1dc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483876:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483882:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483887:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483898:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.483901:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483908:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483917:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:1.0:1787790999.483920:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787790999.483923:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483929:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f261 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483943:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483948:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483954:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483959:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787790999.483962:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483967:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483985:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:1.0:1787790999.483987:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787790999.483990:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.483995:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb000/0xcf9477fddcf1f2d8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.484633:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.484964:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250262784 00000100:00100000:3.0:1787790999.484974:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250262784 00000100:00100000:3.0:1787790999.485045:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:1.0:1787790999.487295:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2403:x1874634250262784:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787790999.488116:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2403:x1874634250262784:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 3053us (3484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790999.488142:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:2.0:1787790999.506836:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.507069:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263040 00000100:00100000:0.0:1787790999.507082:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263040 00000100:00100000:0.0:1787790999.507164:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:0.0:1787790999.507176:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+15:15644:x1874634250263040:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787790999.507447:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790999.507482:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb200/0xcf9477fddcf1f2ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240f3 expref: 15 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.507507:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:0.0:1787790999.507514:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787790999.507556:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.507604:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.507616:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787790999.507849:0:17135:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025985ffa reply state 0000000082728ef4 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.507864:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.507872:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:0.0:1787790999.507875:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787790999.507877:0:17135:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787790999.508438:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:15644:x1874634250263040:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1258us (1612us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787790999.508448:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:0.0:1787790999.529132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790999.529378:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263168 00000100:00100000:2.0:1787790999.529391:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263168 00000100:00100000:2.0:1787790999.529471:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:2.0:1787790999.529482:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:15644:x1874634250263168:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787790999.529505:0:18640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790999.529530:0:18640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224101 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.529587:0:18640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 8 pid: 19573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.529615:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790999.529620:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790999.529628:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 8 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.529675:0:18640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 8 pid: 19573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.529693:0:18640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 8 pid: 19573 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.529765:0:18640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18640:1874634268156928:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787790999.529893:0:18640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.535138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.535373:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263296 00000100:00100000:0.0:1787790999.535386:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263296 00010000:00010000:0.0:1787790999.535444:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 9 pid: 19573 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790999.535496:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:0.0:1787790999.535509:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:2402:x1874634250263296:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790999.535532:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790999.535565:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 9 pid: 19573 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.535618:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 9 pid: 19573 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.535658:0:17119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790999.535664:0:17119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790999.535674:0:17119:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 9 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.535688:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 9 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.535810:0:17119:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 9 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790999.535829:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b17480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17119:1874634268157056:192.168.202.22@tcp:105: 00000100:00100000:0.0:1787790999.535953:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00010000:00010000:2.0:1787790999.536505:0:18640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f2f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240fa expref: 9 pid: 19573 timeout: 648 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.536535:0:18640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18640:1874634268156928:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790999.536579:0:18640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 8 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.536595:0:18640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3000, rc 0) 00000100:00100000:2.0:1787790999.536650:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+8:15644:x1874634250263168:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 7168us (7533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790999.536676:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787790999.547817:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b17480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17119:1874634268157056:192.168.202.22@tcp:105: 00010000:00010000:0.0:1787790999.547857:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790999.547943:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2402:x1874634250263296:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 12435us (12820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.547958:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787790999.551692:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790999.551880:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263424 00000100:00100000:2.0:1787790999.551895:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263424 00000100:00100000:2.0:1787790999.551983:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:2.0:1787790999.551995:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2403:x1874634250263424:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787790999.552390:0:18642:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787790999.552395:0:18642:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787791000 00002000:00010000:2.0:1787790999.552398:0:18642:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787790999 00002000:00010000:2.0:1787790999.552401:0:18642:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787791000 -> 1787791000 00002000:00010000:2.0:1787790999.552403:0:18642:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787790999.552492:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+8:2403:x1874634250263424:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 499us (815us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787790999.552502:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:3.0:1787790999.568065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790999.568348:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263552 00000100:00100000:1.0:1787790999.568361:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263552 00000100:00100000:1.0:1787790999.568440:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:1.0:1787790999.568453:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+8:2403:x1874634250263552:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787790999.568515:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.568543:0:18643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 8 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.568553:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787790999.568559:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787790999.568564:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.568639:0:18643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 8 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.568656:0:18643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 8 pid: 18640 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790999.568676:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18643:1874634268157184:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790999.568846:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.583805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.583942:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263680 00000100:00100000:0.0:1787790999.583955:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263680 00010000:00010000:0.0:1787790999.584017:0:17121:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 9 pid: 18640 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790999.584104:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:0.0:1787790999.584117:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:2402:x1874634250263680:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790999.584141:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790999.584171:0:17121:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 9 pid: 18640 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.584189:0:17121:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 9 pid: 18640 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.584355:0:17121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790999.584361:0:17121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787790999.584369:0:17121:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.584382:0:17121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.584409:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790999.584487:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:2402:x1874634250263680:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 372us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.584495:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00010000:00010000:2.0:1787790999.589846:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000156f0086/0xcf9477fddcf1f302 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224101 expref: 8 pid: 18640 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.589880:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18643:1874634268157184:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787790999.589914:0:18643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.589930:0:18643:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.589938:0:18643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.589998:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.590008:0:18643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.590016:0:18643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.590024:0:18643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790999.590029:0:18643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.590646:0:18643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.590679:0:18643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.590688:0:18643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003817ff2a/0xcf9477fddcf1f309 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.590867:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2403:x1874634250263552:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 22415us (22828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790999.590893:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:1.0:1787790999.593435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.593555:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250263936 00000100:00100000:0.0:1787790999.593568:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250263936 00000100:00100000:0.0:1787790999.593664:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:0.0:1787790999.593678:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:15644:x1874634250263936:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787790999.593979:0:18527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.594003:0:18527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 16 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.594015:0:18527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.594135:0:18527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 16 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.594151:0:18527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 16 pid: 17136 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790999.594169:0:18527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18527:1874634268157312:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787790999.594448:0:18527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787790999.605598:0:18527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18527:1874634268157312:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790999.605635:0:18527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790999.607507:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.607887:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264064 00000100:00100000:0.0:1787790999.607900:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264064 00010000:00010000:0.0:1787790999.607958:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 17 pid: 17136 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787790999.608009:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787790999.608020:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+17:2402:x1874634250264064:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787790999.608149:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787790999.608159:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 17 pid: 17136 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608175:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 17 pid: 17136 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608202:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2000/0xcf9477fddcf1f25a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240c2 expref: 17 pid: 17136 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608230:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:0.0:1787790999.608237:0:17119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 16 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608250:0:17119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608259:0:17119:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608267:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.608300:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787790999.608362:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:2402:x1874634250264064:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 343us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787790999.608370:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00010000:00010000:1.0:1787790999.609370:0:18527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.609386:0:18527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.609765:0:18527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.609795:0:18527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 16 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.609806:0:18527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.609849:0:18527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 16 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.609873:0:18527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 16 pid: 17134 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787790999.609892:0:18527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18527:1874634268157440:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787790999.610297:0:18527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.616581:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.616782:0:18527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18527:1874634268157440:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787790999.616844:0:18527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.616952:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264192 00000100:00100000:2.0:1787790999.616961:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264192 00010000:00010000:2.0:1787790999.617009:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 17 pid: 17134 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.617065:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:2.0:1787790999.617077:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+17:2403:x1874634250264192:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787790999.617099:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787790999.617107:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 17 pid: 17134 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.617122:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 17 pid: 17134 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.617150:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4800/0xcf9477fddcf1f2df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240ec expref: 17 pid: 17134 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.617171:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:2.0:1787790999.617177:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.617188:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.617197:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.617400:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787790999.617532:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:2403:x1874634250264192:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 456us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790999.617542:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00010000:00010000:0.0:1787790999.617652:0:18527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.617660:0:18527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787790999.617871:0:18527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787790999.618017:0:18527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787790999.618073:0:18527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787790999.618170:0:18527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18527:1874634268157568:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787790999.618253:0:18527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787790999.618289:0:18527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.619895:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268157568 00000100:00100000:1.0:1787790999.619927:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268157568 00000100:00100000:1.0:1787790999.620007:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787790999.620020:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18527:x1874634268157568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787790999.620880:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18527:x1874634268157568:12345-0@lo:1000:mdt00_003.0 Request processed in 858us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787790999.620892:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787790999.621112:0:18527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18527:1874634268157568:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787790999.621367:0:18527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787790999.621480:0:18527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18527:1874634268157696:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787790999.621541:0:18527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787790999.621581:0:18527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.621873:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268157696 00000100:00100000:1.0:1787790999.621881:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268157696 00000100:00100000:1.0:1787790999.621940:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787790999.621950:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18527:x1874634268157696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787790999.622123:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:18527:x1874634268157696:12345-0@lo:1000:mdt00_003.0 Request processed in 174us (581us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787790999.622131:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787790999.622365:0:18527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18527:1874634268157696:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787790999.622689:0:18527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.622805:0:18527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.622816:0:18527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.622823:0:18527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790999.622828:0:18527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.622837:0:18527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.622858:0:18527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:2.0:1787790999.622862:0:18527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790999.622886:0:18527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.622893:0:18527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4000/0xcf9477fddcf1f317 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623185:0:18527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623194:0:18527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623201:0:18527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623272:0:18527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790999.623277:0:18527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623285:0:18527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623295:0:18527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790999.623298:0:18527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787790999.623308:0:18527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 19 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623322:0:18527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 19 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623333:0:18527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 19 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.623655:0:18527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 19 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.623674:0:18527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18527:1874634268157824:192.168.202.22@tcp:105: 00000100:00100000:2.0:1787790999.623812:0:18527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787790999.632527:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787790999.632763:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264320 00000100:00100000:3.0:1787790999.632784:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264320 00000100:00100000:3.0:1787790999.632849:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:3.0:1787790999.632860:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbead450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+20:15642:x1874634250264320:12345-192.168.202.22@tcp:49:dd.0 00000100:00100000:3.0:1787790999.633120:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbead450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+20:15642:x1874634250264320:12345-192.168.202.22@tcp:49:dd.0 Request processed in 260us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787790999.633129:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:2.0:1787790999.635828:0:18527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18527:1874634268157824:192.168.202.22@tcp:105: 00010000:00010000:2.0:1787790999.635871:0:18527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.635883:0:18527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbe00/0xcf9477fddcf1f26f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.635939:0:18527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.635964:0:18527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.635979:0:18527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.635991:0:18527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.635998:0:18527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636005:0:18527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636032:0:18527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790999.636037:0:18527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636056:0:18527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636071:0:18527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790999.636074:0:18527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787790999.636078:0:18527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636084:0:18527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d3000/0xcf9477fddcf1f31e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636095:0:18527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636100:0:18527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636106:0:18527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636110:0:18527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787790999.636113:0:18527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636118:0:18527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636137:0:18527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790999.636139:0:18527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790999.636142:0:18527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.636148:0:18527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f600/0xcf9477fddcf1f310 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787790999.636382:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+19:15644:x1874634250263936:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 42705us (42960us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787790999.636394:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000020:00080000:2.0:1787790999.636402:0:18527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787790999.637327:0:17168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787790999.637336:0:17168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787790999.637356:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787790999.637364:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787790999.639167:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790999.639645:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264448 00000100:00100000:2.0:1787790999.639658:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264448 00000100:00100000:2.0:1787790999.639751:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:2.0:1787790999.639764:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+19:15642:x1874634250264448:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:2.0:1787790999.639803:0:19928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787790999.639830:0:19928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f325 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224108 expref: -99 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.639878:0:19928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f32c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.639896:0:19928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f32c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.639910:0:19928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f32c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.640097:0:19928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f325 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224108 expref: 21 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.640121:0:19928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f32c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224108 expref: 20 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.640132:0:19928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:2.0:1787790999.640135:0:19928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787790999.640139:0:19928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2800, rc 0) 00000100:00100000:2.0:1787790999.640487:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+20:15642:x1874634250264448:12345-192.168.202.22@tcp:101:dd.0 Request processed in 724us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787790999.640496:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:3.0:1787790999.646388:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787790999.648685:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264704 00000100:00100000:1.0:1787790999.648837:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264704 00000100:00100000:1.0:1787790999.648989:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787790999.649004:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+20:15644:x1874634250264704:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787790999.649407:0:17138:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787790999.649458:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787790999.649499:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.649521:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.649537:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.649547:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.649554:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.649562:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787790999.649589:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787790999.649744:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+22:15644:x1874634250264704:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 742us (3370us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787790999.649754:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000020:00080000:1.0:1787790999.649760:0:17138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787790999.649841:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787790999.649850:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.649858:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787790999.649863:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.649871:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.649888:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:2.0:1787790999.649891:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787790999.649897:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.649926:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4c00/0xcf9477fddcf1f333 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.649942:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790999.649944:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787790999.649946:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787790999.755926:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787790999.819259:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787790999.872250:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787790999.873415:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264832 00000100:00100000:2.0:1787790999.873432:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264832 00000100:00100000:2.0:1787790999.873536:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:2.0:1787790999.873549:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+7:2401:x1874634250264832:12345-192.168.202.22@tcp:4:dd.0 00002000:00010000:2.0:1787790999.873844:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f8698, atime: 0x6a8f8697, ctime: 0x6a8f8698, blocks: 0x0 00010000:00010000:2.0:1787790999.873858:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.873882:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1787790999.873888:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787790999.873897:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787790999.873981:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787790999.875155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787790999.876051:0:18648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787790999.876066:0:18648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787790999.879793:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250264960 00000100:00100000:1.0:1787790999.879811:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250264960 00000100:00100000:0.0:1787790999.881190:0:20275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:0.0:1787790999.881268:0:20275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+8:2401:x1874634250264960:12345-192.168.202.22@tcp:4:dd.0 00010000:00010000:0.0:1787790999.881323:0:20275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.881348:0:20275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790999.881354:0:20275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787790999.881363:0:20275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787790999.881380:0:20275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787791000.017106:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1787791000.017134:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1787791000.018174:0:18646:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:3.0:1787791000.018195:0:18646:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787791000 -> 1787791001 00002000:00010000:3.0:1787791000.018198:0:18646:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787791000 -> 1787791001 00002000:00010000:3.0:1787791000.018200:0:18646:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:3.0:1787791000.018223:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791000.018307:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791000.018318:0:18646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791000.018327:0:18646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791000.018333:0:18646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791000.018343:0:18646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791000.018369:0:18646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791000.018377:0:18646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854a0183/0xcf9477fddcf1f33a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791000.018580:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+9:2401:x1874634250264832:12345-192.168.202.22@tcp:4:dd.0 Request processed in 145026us (146339us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787791000.018599:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000001:00080000:1.0:1787791000.022126:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:2.0:1787791000.022668:0:20275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791000.022686:0:20275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791000.022737:0:20275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791000.022746:0:20275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791000.022752:0:20275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791000.022763:0:20275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791000.022796:0:20275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791000.022806:0:20275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c07693/0xcf9477fddcf1f341 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791000.023197:0:20275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250264960:12345-192.168.202.22@tcp:4:dd.0 Request processed in 141985us (148040us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787791000.023212:0:20275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00010000:00010000:1.0:1787791000.855823:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787791001.647100:0:20313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787791001.869402:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791002.891571:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41760 lines, 41760 kept, 0 dropped, 0 bad.